REPORT  DOCUMENTATION  PAGE 


Form  Approved  OMB  NO.  0704-0188 


The  public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions, 
searching  existing  data  sources,  gathering  and  maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments 

regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggesstions  for  reducing  this  burden,  to  Washington 

Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington  VA,  22202-4302. 
Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  any  oenalty  for  failing  to  comply  with  a  collection  of 
information  if  it  does  not  display  a  currently  valid  OMB  control  number. 

PLEASE  DO  NOT  RETURN  YOUR  FORM  TO  THE  ABOVE  ADDRESS. 


1.  REPORT  DATE  (DD-MM-YYYY) 


2.  REPORT  TYPE 
New  Reprint 


4.  TITLE  AND  SUBTITLE 

Time-Critical  Cooperative  Path  Following  of  Multiple 
Unmanned  Aerial  Vehicles  over  Time-Varying  Networks 


3.  DATES  COVERED  (From  -  To) 


5a.  CONTRACT  NUMBER 
W91  INF- 10- 1-0044 


5b.  GRANT  NUMBER 


6.  AUTHORS 

E.  Xargay,  I.  Kaminer,  A.  Pascoal,  N.  Hovakimyan,  V.  Dobrokhodov, 
V.  Cichella,  A.  P.  Aguiar,  R.  Ghabcheloo 


5c.  PROGRAM  ELEMENT  NUMBER 
611102 


5d.  PROJECT  NUMBER 


5e.  TASK  NUMBER 


7.  PERFORMING  ORGANIZATION  NAMES  AND  ADDRESSES 

University  of  Illinois  -  Urbana 

Board  of  Trustees  of  the  University  of  Illinois 

1901  S  First  Street 

Champaign,  IL  61820  -7473 


9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND 
ADDRESS(ES) 

U.S.  Army  Research  Office 
P.O.Box  12211 

Research  Triangle  Park,  NC  27709-2211 


5f.  WORK  UNIT  NUMBER 


8.  PERFORMING  ORGANIZATION  REPORT 
NUMBER 


10.  SPONSOR/MONITOR'S  ACRONYM(S) 
ARO 


11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

55839-NS.28 


12.  DISTRIBUTION  AVAILIBILITY  STATEMENT 
Approved  for  public  release;  distribution  is  unlimited. 


13.  SUPPLEMENTARY  NOTES 

The  views,  opinions  and/or  findings  contained  in  this  report  are  those  of  the  author(s)  and  should  not  contrued  as  an  official  Department 
of  the  Army  position,  policy  or  decision,  unless  so  designated  by  other  documentation. 


14.  ABSTRACT 

This  paper  addresses  the  problem  of  steering  a  fleet  of  unmanned  aerial  vehicles  along  desired  three-dimensional 
paths  while  meeting  stringent  spatial  and  temporal  constraints.  A  representative  example  is  the  challenging  mission 
scenario  where  the  unmanned  aerial  vehicles  are  tasked  to  cooperatively  execute  collision- free  maneuvers  and 
arrive  at  their  final  destinations  at  the  same  time.  In  the  proposed  framework,  the  unmanned  aerial  vehicles  are 
assigned  nominal  spatial  paths  and  speed  profiles  along  those,  and  then  the  vehicles  are  requested  to  execute 


15.  SUBJECT  TERMS 

Time  varying  networks,  path  following,  time  critical,  UAV 


16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 

15.  NUMBER 

19a.  NAME  OF  RESPONSIBLE  PERSON 

a.  REPORT 

b.  ABSTRACT 

c.  THIS  PAGE 

ABSTRACT 

OF  PAGES 

Naira  Hovakimyan 

UU 

UU 

UU 

UU 

19b.  TELEPHONE  NUMBER 

217-244-1672 

Standard  Form  298  (Rev  8/98) 
Prescribed  by  ANSI  Std.  Z39. 1 8 


Report  Title 

Time-Critical  Cooperative  Path  Following  of  Multiple  Unmanned  Aerial  Vehicles  over  Time-Varying  Networks 

ABSTRACT 

This  paper  addresses  the  problem  of  steering  a  fleet  of  unmanned  aerial  vehicles  along  desired  three-dimensional 
paths  while  meeting  stringent  spatial  and  temporal  constraints.  A  representative  example  is  the  challenging  mission 
scenario  where  the  unmanned  aerial  vehicles  are  tasked  to  cooperatively  execute  collision-free  maneuvers  and  arrive 
at  their  final  destinations  at  the  same  time.  In  the  proposed  framework,  the  unmanned  aerial  vehicles  are  assigned 
nominal  spatial  paths  and  speed  profiles  along  those,  and  then  the  vehicles  are  requested  to  execute  cooperative  path 
following,  rather  than  open  loop  trajectory  tracking  maneuvers.  This  strategy  yields  robust  behavior  against  external 
disturbances  by  allowing  the  unmanned  aerial  vehicles  to  negotiate  their  speeds  along  the  paths  in  response  to 
information  exchanged  over  the  supporting  communications  network.  The  paper  considers  the  case  where  the  graph 
that  captures  the  underlying  time-varying  communications  topology  is  disconnected  during  some  interval  of  time  or 
even  fails  to  be  connected  at  all  times.  Conditions  are  given  under  which  the  cooperative  path-following  closed-loop 
system  is  stable.  Flight  test  results  of  a  coordinated  road-search  mission  demonstrate  the  efficacy  of  the  multi-vehicle 
cooperative  control  framework  developed  in  the  paper 


REPORT  DOCUMENTATION  PAGE  (SF298) 
(Continuation  Sheet) 


Continuation  for  Block  13 


ARO  Report  Number  55839. 28-NS 

Time-Critical  Cooperative  Path  Following  of  Mul 


Block  13:  Supplementary  Note 

©2013  .  Published  in  Journal  of  Guidance,  Control,  and  Dynamics,  Vol.  Ed.  0  36,  (2)  (201 3),  (,  (2).  DoD  Components  reserve  a 
royalty-free,  nonexclusive  and  irrevocable  right  to  reproduce,  publish,  or  otherwise  use  the  work  for  Federal  purposes,  and  to 
authroize  others  to  do  so  (DODGARS  §32.36).  The  views,  opinions  and/or  findings  contained  in  this  report  are  those  of  the 
author(s)  and  should  not  be  construed  as  an  official  Department  of  the  Army  position,  policy  or  decision,  unless  so  designated  by 
other  documentation. 


Approved  for  public  release;  distribution  is  unlimited. 


Downloaded  by  UNIVERSITY  OF  ILLINOIS  on  April  22,  2013  I  http://arc.aiaa.org  I  DOI:  10.2514/1.56538 


Journal  of  Guidance,  Control,  and  Dynamics 

Vol.  36,  No.  2,  March-April  2013 


Time- Critical  Cooperative  Path  Following  of  Multiple  Unmanned 
Aerial  Vehicles  over  Time- Varying  Networks 


E.  Xargay* 

University  of  Illinois  at  Urbana-Champaign,  Urbana,  Illinois  61801 

I.  Kaminer' 

Naval  Postgraduate  School,  Monterey,  California  93943 
A.  PascoaF 

Instituto  Superior  Tecnico,  1049  Lisbon,  Portugal 
N.  Hovakimyan5 

University  of  Illinois  at  Urbana-Champaign,  Urbana,  Illinois  61801 
V.  Dobrokhoclov"1  and  V.  Cichella** 

Naval  Postgraduate  School,  Monterey,  California  93943 
A.  P.  Aguiar1"1' 

Instituto  Superior  Tecnico,  1049  Lisbon,  Portugal 
and 

R.  Ghabcheloo« 

Tampere  University  of  Technology,  33720  Tampere,  Finland 

DOI:  10.2514/1.56538 

This  paper  addresses  the  problem  of  steering  a  fleet  of  unmanned  aerial  vehicles  along  desired  three-dimensional 
paths  while  meeting  stringent  spatial  and  temporal  constraints.  A  representative  example  is  the  challenging  mission 
scenario  where  the  unmanned  aerial  vehicles  are  tasked  to  cooperatively  execute  collision-free  maneuvers  and  arrive 
at  their  final  destinations  at  the  same  time.  In  the  proposed  framework,  the  unmanned  aerial  vehicles  are  assigned 
nominal  spatial  paths  and  speed  profiles  along  those,  and  then  the  vehicles  are  requested  to  execute  cooperative  path 
following,  rather  than  open  loop  trajectory  tracking  maneuvers.  This  strategy  yields  robust  behavior  against  external 
disturbances  by  allowing  the  unmanned  aerial  vehicles  to  negotiate  their  speeds  along  the  paths  in  response  to 
information  exchanged  over  the  supporting  communications  network.  The  paper  considers  the  case  where  the  graph 
that  captures  the  underlying  time-varying  communications  topology  is  disconnected  during  some  interval  of  time  or 
even  fails  to  be  connected  at  all  times.  Conditions  are  given  under  which  the  cooperative  path-following  closed-loop 
system  is  stable.  Flight  test  results  of  a  coordinated  road-search  mission  demonstrate  the  efficacy  of  the  multi- vehicle 
cooperative  control  framework  developed  in  the  paper. 

I.  Introduction 

NMANNED  aerial  vehicles  (UAVs)  are  becoming  ubiquitous 
and  have  been  playing  an  increasingly  important  role  in  military 
reconnaissance  and  strike  operations,  border-patrol  missions,  forest- 
fire  detection,  police  surveillance,  and  recovery  operations,  to  name 
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but  a  few.  In  simple  applications,  a  single  autonomous  vehicle  can  be 
managed  by  a  crew  using  a  ground  station  provided  by  the  vehicle 
manufacturer.  The  execution  of  more  challenging  missions,  however, 
requires  the  use  of  multiple  vehicles  working  in  cooperation  to 
achieve  a  common  objective.  Representative  examples  of  coopera¬ 
tive  mission  scenarios  are  sequential  auto-landing  and  coordinated 
ground-target  suppression  for  multiple  UAVs.  The  first  refers  to  the 
situation  where  a  fleet  of  UAVs  must  break  up  and  arrive  at  the 
assigned  glideslope  point,  separated  by  prespecified  safeguarding 
time  intervals.  In  the  case  of  ground-target  suppression,  a  formation 
of  UAV s  must  also  break  up  and  execute  a  coordinated  maneuver  to 
arrive  at  predefined  positions  over  the  target  at  the  same  time. 

In  both  cases,  only  relative  (rather  than  absolute)  temporal 
constraints  are  given  a  priori,  a  critical  point  that  needs  to  be  empha¬ 
sized.  Furthermore,  the  vehicles  must  execute  maneuvers  in  close 
proximity  to  each  other.  In  addition,  as  pointed  out  in  [1,2],  the 
flow  of  information  among  vehicles  may  be  severely  restricted, 
either  for  security  reasons  or  because  of  tight  bandwidth  limitations. 
As  a  consequence,  no  vehicle  might  be  able  to  communicate 
with  the  entire  formation,  and  the  amount  of  information  that  can 
be  exchanged  might  be  limited.  Moreover,  the  topology  of  the 
intervehicle  communications  network  supporting  the  cooperative 
mission  may  change  over  time.  Under  these  circumstances,  it  is 
important  to  develop  cooperative  motion-control  strategies  that  can 
yield  robust  performance  in  the  presence  of  time-varying  communi¬ 
cations  networks  arising  from  temporary  loss  of  communications 
links  and  switching  communications  topologies. 

Motivated  by  these  and  similar  problems,  there  has  been  increasing 
interest  over  the  past  few  years  in  the  study  of  multi-agent  system 
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networks  with  applications  to  engineering  and  science  problems. 
The  range  of  topics  addressed  include  parallel  computing  [3], 
synchronization  of  oscillators  [4],  study  of  collective  behavior  and 
flocking  [5],  multisystem  consensus  mechanisms  [6],  multivehicle 
system  formations  [7-10],  coordinated  motion  control  [11-13], 
cooperative  path  and  trajectory  planning  [14-18],  asynchronous 
protocols  [19],  dynamic  graphs  [20],  stochastic  graphs  [20-22],  and 
graph-related  theory  [2,23].  Especially  relevant  are  the  applications 
of  the  theory  developed  in  the  area  of  multivehicle  formation  control: 
spacecraft  formation  flying  [24],  UAV  control  [25,26],  coordinated 
control  of  land  robots  [11],  and  control  of  multiple  autonomous 
underwater  vehicles  and  surface  vessels  [27-36].  In  spite  of  sig¬ 
nificant  progress  in  the  field,  much  work  remains  to  be  done  to 
develop  strategies  capable  of  yielding  robust  performance  of  a  fleet  of 
vehicles  in  the  presence  of  complex  vehicle  dynamics,  communi¬ 
cations  constraints,  and  partial  vehicle  failures. 

It  is  against  this  backdrop  of  ideas  that  this  paper  addresses  the 
problem  of  steering  a  fleet  of  UAVs  along  desired  paths  while 
meeting  stringent  spatial  and  temporal  constraints.  The  cooperative 
missions  considered  here  require  that  the  UAV s  follow  collision-free 
paths  and  that  all  vehicles  arrive  at  their  final  destinations  at  the  same 
time  (time-critical  operations).  In  the  adopted  setup,  the  vehicles 
are  assigned  desired  nominal  paths  and  speed  profiles  along  them. 
The  paths  are  then  appropriately  parameterized,  and  the  vehicles  are 
requested  to  execute  cooperative  path  following,  rather  than  open- 
loop  trajectory-tracking  maneuvers.  This  strategy  yields  robust 
performance  in  the  face  of  external  disturbances  by  allowing  the 
vehicles  to  negotiate  their  speeds  along  the  paths  in  response  to 
information  exchanged  over  the  supporting  communications 
network.  Moreover,  as  proven  in  [37],  the  path-following  approach 
is  not  subject  to  the  fundamental  performance  limitations  of 
trajectory  tracking  in  the  presence  of  unstable  zero  dynamics.  The 
paper  builds  upon  previous  work  by  the  authors  on  time-critical 
cooperative  path  following  and  extends  it  to  a  very  general  frame¬ 
work  that  allows  for  the  consideration  of  complex  vehicle 
dynamics  and  time-varying  communications  topologies  in  a  rigorous 
mathematical  setting.  The  reader  is  referred  to  [38-43]  and  the 
references  therein  for  an  introduction  to  the  subject  and  a  general 
perspective  of  the  circle  of  ideas  that  are  at  the  root  of  the  present 
work.  From  a  technical  point  of  view,  the  present  paper  departs 
substantially  from  previous  published  work  in  two  key  aspects. 

1)  It  puts  forward  a  new  algorithm  for  path  following  in  three- 
dimensional  (3-D)  space  that  uses  the  special  orthogonal  group 
SO(3)  in  the  formulation  of  the  attitude-control  problem.  This 
formulation  avoids  the  geometric  singularities  and  complexities 
that  appear  when  dealing  with  local  parameterizations  of  the 
vehicle’s  attitude  and  thus  leads  to  a  singularity-free  path-following 
control  law. 

2)  It  offers  a  new  proof  of  convergence  of  the  relevant  variables 
involved  in  cooperative  path  following  that  significantly  simplifies 
the  one  summarized  in  [40]  and  extends  it  to  the  case  where  the 
speed  profiles  of  the  different  vehicles  along  their  paths  are  arbitrary 
but  meet  desired  geometrical  constraints.  In  the  setup  adopted,  the 
communications  graph  that  captures  the  underlying  communications 
network  topology  is  allowed  to  be  disconnected  during  some  interval 
of  time  or  may  even  fail  to  be  connected  at  all  times.  It  is  shown  that,  if 
the  connectivity  of  the  communications  graph  satisfies  a  certain 
persistency  of  excitation  (PE)-like  condition,  then  the  UAV s  “reach 
consensus”  in  the  sense  that  a  conveniently  defined  cooperation  error 
converges  to  a  neighborhood  of  the  origin.  The  paper  also  derives 
lower  bounds  on  the  convergence  rate  of  the  collective  dynamics  as  a 
function  of  the  level  of  connectivity  of  the  dynamic  communications 
graph. 

To  demonstrate  the  efficacy  of  the  developed  algorithms,  the  paper 
also  presents  flight-test  results  of  a  coordinated  road-search  mission 
that  exploits  the  multi-UAV  cooperative  control  framework  devel¬ 
oped.  These  experimental  results  build  on  the  ones  reported  in  [44]  by 
analyzing  in  greater  detail  the  performance  of  the  road-search 
mission. 

This  paper  is  organized  as  follows.  Section  II  formulates  the  time- 
critical  cooperative  path-following  problem,  describes  the  kinemat¬ 


ics  of  the  systems  of  interest,  and  introduces  a  set  of  assumptions  and 
limitations  on  the  supporting  communications  network.  Section  III 
presents  a  path-following  control  algorithm  for  UAVs  in  3-D 
space.  Section  IV  derives  a  strategy  for  time-critical  cooperative  path 
following  of  multiple  UAV s  in  the  presence  of  time- varying 
communications  networks  that  relies  on  the  adjustment  of  the  desired 
speed  profile  of  each  vehicle.  Section  V  addresses  the  stability  and 
convergence  properties  of  the  combined  coordination  and  path¬ 
following  systems.  Section  VI  presents  actual  flight-test  results 
performed  in  Camp  Roberts,  CA.  Finally,  Sec.  VII  summarizes  the 
key  results  and  contains  the  main  conclusions. 

The  following  notation  is  used  throughout  the  paper.  {v\F  is  used 
to  denote  the  vector  v  resolved  in  frame  F ;  {e}F  represents  the  versor 
e  resolved  in  frame  F;  denotes  the  angular  velocity  of  frame 

F 1  with  respect  to  frame  F2;  the  rotation  matrix  from  frame  .FI  to 
frame  F2  is  represented  by  RF^{\  and  t)]F  indicates  that  the  time- 
derivative  of  vector  v  is  taken  in  frame  F.  Moreover,  unless  otherwise 
noted,  ||  •  ||  is  used  for  both  the  2-norm  of  a  vector  and  the  induced 
2-norm  of  a  matrix.  Finally,  SO(3)  denotes  the  special  orthogonal 
group  in  Euclidean  3-space,  while  so(3)  represents  the  set  of  3  X  3 
skew-symmetric  matrices  over  R. 

II.  Time-Critical  Cooperative  Path  Following: 
Problem  Formulation 

This  section  provides  a  rigorous  formulation  of  the  problem  of 
time-critical  cooperative  path-following  control  for  multiple  UAV s 
in  3-D  space,  in  which  a  fleet  of  UAV s  is  tasked  to  converge  to 
and  follow  a  set  of  desired  feasible  paths  so  as  to  meet  spatial  and 
temporal  constraints.  The  section  also  introduces  a  set  of  assumptions 
and  limitations  on  the  supporting  communications  network. 

The  problem  of  cooperative  trajectory  generation  is  not  addressed 
in  this  paper.  In  fact,  it  is  assumed  that  a  set  of  desired  3-D  time 
trajectories  pdd(td):  R ->  R3,  conveniently  parameterized  by  a 
single  time  variable  td  G  [0,  fj],  is  known  for  all  of  the  n  UAV s 
involved  in  a  cooperative  mission.  The  variable  td  represents  a 
desired  mission  time  (distinct  from  the  actual  mission  time  that 
evolves  as  the  mission  unfolds),  with  t*d  being  the  desired  mission 
duration.  For  a  given  td,  pdd{td )  defines  the  desired  position  of 
the  ;th  UAV  td  seconds  after  the  initiation  of  the  cooperative  mission. 
These  time  trajectories  can  be  reparameterized  in  terms  of  path 
length  to  obtain  spatial  paths  pdj(??j)  ■  R  -*■  R3  (with  no  temporal 
specifications)  and  the  corresponding  desired  speed  profiles 
vdi(td):  R  -»•  R.  For  convenience,  each  spatial  path  is  parame¬ 
terized  by  its  path  length  Tfd  G  [0,  € '«],  where  € fi  denotes  the  total 
length  of  the  ith  path,  whereas  the  desired  speed  profiles  are 
parameterized  by  the  desired  mission  time  td.  It  is  assumed  that 
both  the  paths  and  the  speed  profiles  satisfy  collision-avoidance 
constraints  as  well  as  appropriate  boundary  and  feasibility  condi¬ 
tions,  such  as  those  imposed  by  the  physical  limitations  of  the  UAVs. 
In  particular,  in  the  context  of  this  paper,  it  is  assumed  that  the  paths 
are  spatially  deconflicted  with  spatial  clearance  E  >  0.  (The  results  in 
the  present  paper  can  be  easily  extended  to  time-deconflicted  paths; 
one  only  needs  to  replace  the  condition  in  Theorem  1  that  relates  the 
spatial  clearance  E  to  the  path-following  and  coordination  error 
bounds;  see  Remark  6.)  It  is  further  assumed  that  the  rate  and  speed 
commands  required  to  follow  the  paths  and  achieve  time  coordination 
do  not  result  in  the  UAVs  operating  outside  their  normal  flight 
envelope  and  do  not  lead  to  internal  saturation  of  the  onboard 
autopilots.  The  problem  of  generation  of  feasible  collision-free 
trajectories  for  multiple  cooperative  autonomous  vehicles  is 
described  in  detail  in  [44]. 

A.  Path  Following  for  a  Single  Unmanned  Aerial  Vehicle 

Pioneering  work  in  the  area  of  path  following  can  be  found  in  [45], 
where  an  elegant  solution  to  the  problem  was  presented  for  a  wheeled 
robot  at  the  kinematic  level.  In  the  setup  adopted,  the  kinematic 
model  of  the  vehicle  was  derived  with  respect  to  a  Frenet-Serret 
frame  moving  along  the  path,  while  playing  the  role  of  a  virtual  target 
vehicle  to  be  tracked  by  the  real  vehicle.  The  origin  of  the  Frenet- 
Serret  was  placed  at  the  point  on  the  path  closest  to  the  real  vehicle. 
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This  work  spurred  a  great  deal  of  activity  in  the  literature  addressing 
the  path-following  control  problem.  Of  particular  interest  is  the  work 
reported  in  [46],  in  which  the  authors  reformulated  the  setup  used  in 
[45]  and  derived  a  feedback  control  law  that  steers  the  dynamic  model 
of  a  wheeled  robot  along  a  desired  path  and  overcomes  stringent 
initial  condition  constraints  present  in  [45],  The  key  to  the  algorithm 
in  [46]  is  to  explicitly  control  the  rate  of  progression  of  the  virtual 
target  along  the  path.  This  effectively  creates  an  extra  degree  of 
freedom  that  can  be  exploited  to  avoid  singularities  that  occur  when 
the  distance  to  the  path  is  not  well  defined. 

The  solution  to  the  path-following  problem  described  in  the 
present  paper  extends  to  the  3-D  case  the  algorithm  presented  in  [46], 
and  relies  on  the  insight  that  a  UAV  can  follow  a  given  path  using  only 
its  attitude,  thus  leaving  its  speed  as  an  extra  degree  of  freedom  to  be 
used  at  the  coordination  level.  The  key  idea  of  the  algorithm  is  to  use 
the  vehicle’s  attitude-control  effectors  to  follow  a  virtual  target 
vehicle  running  along  the  path.  To  this  effect,  following  the  approach 
developed  in  [46],  this  section  introduces  a  frame  attached  to  this 
virtual  target  and  defines  a  generalized  error  vector  between  this 
moving  coordinate  system  and  a  frame  attached  to  the  actual  vehicle. 
With  this  setup,  the  path-following  control  problem  is  reduced  to 
that  of  driving  this  generalized  error  vector  to  zero  by  using  only 
the  UAV's  attitude-control  effectors,  while  following  an  arbitrary 
feasible  speed  profile.  Next,  the  dynamics  of  the  kinematic  errors 
between  the  ith  vehicle  and  its  virtual  target  are  characterized. 

Figure  1  captures  the  geometry  of  the  problem  at  hand.  Let  p^(-)  be 
the  desired  path  assigned  to  one  of  the  UAVs,  and  let  € f  be  its  total 
length.  LetX  denote  an  inertial  reference  frame  [e/i ,  e/2,  e23},  and  let 
Pi(t)  be  the  position  of  the  center  of  mass  Q  of  the  UAV  in  this  inertial 
frame.  Further,  let  P  be  an  arbitrary  point  on  the  desired  path  that 
plays  the  role  of  the  virtual  target,  and  let  pj(0  denote  its  position  in 
the  inertial  frame.  Here,  f  G  [0,  f’f]  is  a  free-length  variable  that 
defines  the  position  of  the  virtual  target  vehicle  along  the  path,  fn  the 
setup  adopted,  the  total  rate  of  progression  of  the  virtual  target  along 
the  path  is  an  extra  design  parameter.  This  approach  is  in  striking 
contrast  with  the  strategy  used  in  the  path-following  algorithm 
introduced  in  [45],  where  P  is  defined  as  the  point  on  the  path  that  is 
closest  to  the  vehicle.  Endowing  point  P  with  an  extra  degree  of 
freedom  is  the  key  to  the  path-following  algorithm  presented  in  [46] 
and  its  extension  to  the  3-D  case  described  in  this  paper. 

For  our  purposes,  it  is  convenient  to  define  a  parallel  transport 
frame  T  attached  to  point  P  on  the  path  and  characterized  by 
the  orthonormal  vectors  n1(d),  n2(f)},  which  satisfy  the 

following  frame  equations  [47,48]: 
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where  and  k2(f)  are  related  to  the  polar  coordinates  of 

curvature  x(^)  and  torsion  t(0  as  x(/f)  =  (k2(if)  +  k\(OYl  and 
t(i?)  =  —  ^  (tan_1(&2OOAiOO))- The  vectors  {t,  ii| .  n2}  define  an 
orthonormal  basis  for  T,  in  which  the  unit  vector  t(/f)  defines  the 
tangent  direction  to  the  path  at  the  point  determined  by  £,  while  n  t  (/f) 
and  n2(0  define  the  normal  plane  perpendicular  to  Unlike 
the  Frenet-Serret  frame,  this  moving  frame  is  well  defined  when 
the  path  has  a  vanishing  second  derivative.  This  orthonormal  basis 
can  be  used  to  construct  the  rotation  matrix  RF(d)  =  [{t(tf)}j\ 
[n i(0}i>  {n2 COCA  from  T  to  X.  Furthermore,  the  angular  velocity 
of  T  with  respect  to  X,  resolved  in  T,  can  be  easily  expressed  in  terms 
of  the  parameters  kl(rf)  and  k2(if)  as 

{o>f/i}f  =  1  o,  -k2 CO*,  kiCOfV 

Let  pp(t)  be  the  position  of  the  vehicle's  center  of  mass  Q  in 
the  parallel  transport  frame,  and  let  xF(t),  yF(t),  and  zF(f)  be 
the  components  of  vector  pF(t)  with  respect  to  the  basis  {t,  n  t .  n2}, 
that  is. 


{Pf}f  —  [xf,  Tf>  zf]t 

Finally,  let  W  denote  a  vehicle-carried  velocity  frame  {wj,  w2,  w3} 
with  its  origin  at  the  UAV  center  of  mass  and  its  x  axis  aligned  with  the 
velocity  vector  of  the  UAV.  The  z  axis  is  chosen  to  lie  in  the  plane  of 
symmetry  of  the  UAV,  and  the  y  axis  is  determined  by  completing 
the  right-hand  system.  In  this  paper,  q(t)  and  r(t)  are  the  v-axis  and 
z-axis  components,  respectively,  of  the  vehicle’s  rotational  velocity 
resolved  in  the  W  frame.  With  a  slight  abuse  of  notation,  q(t)  and  r(t) 
will  be  referred  to  as  pitch  rate  and  yaw  rate,  respectively,  in  the  W 
frame. 

Next,  the  previous  notation  is  used  to  characterize  the  kinematic 
error  dynamics  of  the  UAV  with  respect  to  the  virtual  target.  The 
position-error  dynamics  are  derived  first.  For  this  purpose,  note  that 

Pi  =  PdCO  +  Pf 
from  which  it  follows  that 

Pi\i  =  if  t  +  a>F/j  X  pF  +  pF]F 

where  -]2  and  -]F  are  used  to  indicate  that  the  derivatives  are  taken  in 
the  inertial  and  parallel  transport  frames,  respectively.  Because 


Pi ]/  =  uwj 


where  v(t)  denotes  the  magnitude  of  the  UAV's  ground  velocity 
vector,  the  path-following  kinematic  position-error  dynamics  of  the 
UAV  with  respect  to  the  virtual  target  can  be  written  as 


Fig.  1  Following  a  virtual  target  vehicle;  problem  geometry. 


Pf]f  =  di  -  WF/I  X  Pf  +  wt  (1) 

To  derive  the  attitude-error  dynamics  of  the  UAV  with  respect 
to  its  virtual  target,  an  auxiliary  frame  V  {b  1£) ,  b2D,  b3D}  is  first 
introduced.  This  frame  will  be  used  to  shape  the  approach  attitude  to 
the  path  as  a  function  of  the  “cross-track”  error  components  yF  and 
zF.  Frame  V  has  its  origin  at  the  UAV  center  of  mass,  and  vectors 
b b2D(t),  and  b3D(f)  are  defined  as 

A  dt  -  yFnl  -  zFn2  AyFt  +  dn} 

Cd 2  +  yF  +  zfY  (d~  +  y\y 

b3D  —  bi/j  x  b2D  (2) 

with  d  being  a  (positive)  constant  characteristic  distance.  The  basis 
vector  b1D(t)  defines  the  desired  direction  of  the  UAV’s  velocity 
vector.  Clearly,  when  the  vehicle  is  far  from  the  desired  path,  vector 
b\D(t)  becomes  perpendicular  to  t  (if) .  As  the  vehicle  comes  closer  to 
the  path  and  the  cross-track  error  becomes  smaller,  then  b \D{t)  tends 
to  t(0- 
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Next,  let  R(t)  G  SO(3)  be  the  rotation  matrix  from  W  to  D ,  that  is, 

p  A  pD  pD  pF  ( pF\T  pF 

K  —  Kw  —  i<FKw  —  ( Kd )  Kw 

and  define  the  real- valued  error  function  on  SO(3) 

-  ^tr[(i3  -  njns)(i3  -  r)\  0) 

where  is  defined  as  IIS  =  ^  ^  J.  The  function  ¥(/?)  in 

Eq.  (3)  can  be  expressed  in  terms  of  the  entries  of  R(t)  as 
'P(W)  =  (1/2)(1  -/?n),  where  Rn(t)  denotes  the  (1,1)  entry  of 
R(t).  Therefore,  *P (R)  is  a  positive-definite  function  about  Ru  =  1. 
Note  that  Rn  =  1  corresponds  to  the  situation  where  the  velocity 
vector  of  the  UAV  is  aligned  with  the  basis  vector  b1D(t),  which 
defines  the  desired  attitude. 

The  attitude  kinematics  equation 

R  =  Rw  =  Rw({g>w/d}w)A  =  R({cow/d}w)A 

where  (-)A :  R3  so(3)  denotes  the  hat  map  (see  Appendix  A),  can 
be  used  to  derive  the  time  derivative  of  'V(R),  given  by 

*(J R)  =  -  *  tr[(I3  -n£n*)/?({u,w/I)}w)A] 

Equation  (Al)  of  the  hat  map  (see  Appendix  A)  leads  to 

*(«)  =  2  (((it  -  n£n r)r  -  rt(i3  -  nlnR)y)T{ww/D}w 

where  (-)v:  so(3)  -a-  R3  denotes  the  vee  map,  which  is  defined  as 
the  inverse  of  the  hat  map.  Moreover,  because  the  first  component  of 
the  vector  ( (I3  —  n^n^)/?  —  RT(13  —  njllfl))v  is  equal  to  zero,  one 
can  also  write 

'i’(R)  =  QnR((i3  -  nArv)/?  -  F(n3  -  n£n«))vJ  nR{o,w/D}w 

(4) 

Next,  define  the  attitude  error  eR(t)  as 

ek  =  2n«((i3  -  n£n  R)R  -  Rr(  I3  -  n£n«))v 

which  allows  Eq.  (4)  to  be  rewritten  in  the  more  compact  form 
'i'(R)  =  e R 

Note  that  the  attitude  error  eR(t)  can  also  be  expressed  in  terms  of  the 
entries  of  R(t)  as  ek  =  (l/2)[/?13,  - R 12  ]r  and,  therefore,  within 

the  region  where  ^(R)  <  1,  one  has  that,  if  ||  ep  ||  =  0,  then  /?n  =  1. 
Finally,  noting  that  {cow/F}w  can  be  expressed  as 

{iow/d)w  =  {a>w/i)w  +  {g>i/f}w  +  {u>f/d}w 
=  {<*>\ v/l}w  -  RT(Rf{wF/i}f  +  {®Z)/f}D) 

one  obtains 

'V(R)  =  e*  •  (  qr  -  nRRT(RD{wF/I}F  +  {cod/f}d) )  (5) 

This  equation  describes  the  path-following  kinematic  attitude-error 
dynamics  of  frame  W  with  respect  to  frame  T>.  The  path-following 
kinematic-error  dynamics  Qe  can  now  be  obtained  by  combining 
Eqs.  (1)  and  (5),  yielding 


Pf\f  =  “A  _  ®F/1  X  pF  +  l!W|  , 

'V(R)  =  eR- (l  -  n  rRT(R?{cof/i}f  +  (6) 

In  the  kinematic-error  model  [Eq.  (6)],  q(t)  and  r(t)  play  the  role  of 
control  inputs,  while  the  rate  of  progression  if  (t)  of  point  P  along  the 
path  becomes  an  extra  variable  that  can  be  manipulated  at  will.  At  this 
point,  the  path-following  generalized  error  vector  xpf{t)  can  be 
formally  defined  as 

*,/  =  [/&  elf 

Notice  that,  within  the  region  where  '?(/?)  <  1,  if  xpf  =  0,  then  both 
the  path-following  position  error  and  the  path-following  attitude  error 
are  equal  to  zero,  that  is  pF  =  0  and  Rn  =  1. 

Using  the  previous  formulation,  and  given  a  spatially  defined 
feasible  path  pd  (•) ,  the  problem  of  path  following  for  a  single  vehicle 
can  now  be  defined. 

Definition  1  ( path-following  problem):  For  a  given  UAV  (equipped 
with  an  autopilot),  design  feedback  control  laws  for  pitch  rate  q(t), 
yaw  rate  r(t),  and  rate  of  progression  f(t)  of  the  virtual  target  along 
the  path  such  that  all  closed-loop  signals  are  bounded  and  the  path¬ 
following  generalized  error  vector  xpAt)  converges  to  a  neighbor¬ 
hood  of  the  origin  with  a  guaranteed  rate  of  convergence,  regardless 
of  what  the  temporal  speed  assignment  of  the  mission  is  (as  long  as  it 
is  physically  feasible). 

Stated  in  simple  terms,  the  previous  problem  amounts  to  designing 
feedback  laws  so  that  a  UAV  converges  to  and  remains  inside  a  tube 
centered  on  the  desired  path  curve  assigned  to  this  UAV,  for  an 
arbitrary  speed  profile  (subject  to  feasibility  constraints). 

B.  Time-Critical  Coordination  and  Network  Model 

To  enforce  the  temporal  constraints  that  must  be  met  in  real  time 
to  coordinate  the  entire  fleet  of  vehicles,  the  speed  profile  of  each 
vehicle  is  adjusted  based  on  coordination  information  exchanged 
among  the  UAV s  over  a  time-varying  communications  network.  To 
this  effect,  an  appropriate  coordination  variable  needs  to  be  defined 
for  each  vehicle  that  captures  the  objective  of  the  cooperative 
mission,  in  our  case,  simultaneous  arrival  of  all  the  UAV s  at  their  final 
destinations. 

For  this  purpose,  let  tfdj(fd)  be  defined  as  the  desired  normalized 
curvilinear  abscissa  of  the  ith  UAV  along  its  corresponding  path  at  the 
desired  mission  time  td,  which  is  given  by 

=4 ~  I"  vdl(r)  d-r 
z  fi  Jo 

with  and  vd  ,  (•)  being,  respectively,  the  length  of  the  path  and  the 
desired  speed  profile  corresponding  to  the  ith  UAV.  The  trajectory- 
generation  algorithm  ensures  that  the  desired  speed  profiles  vdi(-) 
satisfy  feasibility  conditions,  which  implies  that  the  following 
bounds  hold  for  all  vehicles: 

0  <  umin  <  vd  i  min  <  vd  i(- )  <  vdd  max  <  umax,  i  =  1 . n 

(V) 

where  umin  and  umax  denote,  respectively,  the  minimum  and 
maximum  operating  speeds  of  the  UAV s  involved  in  the  cooperative 
mission,  while  vd  i  min  and  vd  i  max  denote  lower  and  upper  bounds  on 
the  desired  speed  profile  for  the  ith  UAV.  From  the  definition  of 
€’d  ^tf)  and  the  bounds  in  Eq.  (7),  it  follows  that  fd  ftf  is  a  strictly 
increasing  continuous  function  of  td  mapping  [0.  td]  onto  [0,  1],  and 
satisfying  if'di( 0)  =  0  and  tfdi{td)  =  1.  Define  also  tp :  [0,  1]  -* 
[0,  td]  to  be  the  inverse  function  of  tfd  j(td),  td  G  [0,  td\.  Clearly,  qf) 
is  also  a  strictly  increasing  continuous  function  of  its  argument.  Then, 
letting  f-(t)  be  the  normalized  curvilinear  abscissa  at  time  t  of  the  ith 
virtual  target  vehicle  running  along  its  path,  defined  as 
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*fi 

where  «?,-(?)  £  [0,  € ’«]  was  introduced  in  the  previous  section,  define 
the  time  variables 

i  =  i . n 

From  this  definition,  it  follows  that  |(f)  £  [0,  td],  and  therefore  this 
variable  can  be  seen  as  a  virtual  time  that  characterizes  the  status  of 
the  mission  for  the  zth  UAV  at  time  t  in  terms  of  the  desired  mission 
time  td. 

Note  that,  for  any  two  vehicles  i  and  j,  if  £,•( t )  =  fit)  =  t'd  at  a 
given  time  t,  then  f[( t)  =  fdi(td)  and  tfj(t)  =  fdj(td),  which 
implies  that  at  time  t  the  target  vehicles  corresponding  to  UAV s  i  and 
j  have  the  desired  relative  position  along  the  path  at  the  desired 
mission  time  t'd.  Clearly,  if  fit)  =  f(t)  for  all  t  >  0.  then  the  ith  and 
jth  virtual  target  vehicles  maintain  desired  relative  position  along  the 
path  at  all  times  and,  in  particular,  these  two  target  vehicles  arrive  at 
their  final  destinations  at  the  same  time,  which  does  not  necessarily 
correspond  to  the  desired  mission  duration  td.  Also,  in  the  case  of 
collision  avoidance  in  time  (see  [44]),  if  =  f(t)  for  all  t  >  0, 
then  the  solution  to  the  trajectory-generation  problem  ensures  that  the 
virtual  targets  i  and  j  do  not  collide.  Moreover,  if  the  ith  virtual  target 
travels  at  the  desired  speed  for  all  time  in  the  interval  [0,  r],  that  is 
tfj(r)  =  vdi(z)  for  all  t  £  [0,  t\,  then  one  has  that  =  ?d,i  0)  for 
all  r£  [0,  t],  which  implies  that  f(r)  =  t  (or,  equivalently,  that 
f(r)  =  1)  for  all  t  £  [0,  ?].  This  set  of  properties  makes  the  variables 
f(t)  an  appropriate  metric  for  vehicle  coordination,  and  therefore 
they  will  be  referred  to  as  coordination  states.  Notice  that  the  use  of 
these  specific  coordination  variables  is  motivated  by  the  work  in  [4 1  ] . 

To  meet  the  desired  temporal  assignments  of  the  cooperative 
mission,  coordination  information  is  to  be  exchanged  among  the 
UAVs  over  the  supporting  communications  network.  Next,  tools  and 
facts  from  algebraic  graph  theory  are  used  to  model  the  information 
exchange  over  the  time-varying  network  as  well  as  the  constraints 
imposed  by  the  communications  topology  (see  for  example  [9,49] 
and  references  therein).  The  reader  is  also  referred  to  [50]  for  key 
concepts  and  details  on  algebraic  graph  theory. 

First,  to  account  for  the  communications  constraints  imposed  by 
this  intervehicle  network,  it  is  assumed  that  the  ith  UAV  can  only 
exchange  information  with  a  neighboring  set  of  vehicles,  denoted 
here  by  A/”,-.  It  is  also  assumed  that  the  communications  between 
two  UAV s  are  bidirectional  and  that  the  information  is  transmitted 
continuously  with  no  delays.  Moreover,  because  the  flow  of  infor¬ 
mation  among  vehicles  may  be  severely  restricted,  either  for  security 
reasons  or  because  of  tight  bandwidth  limitations,  each  vehicle  is 
only  allowed  to  exchange  its  coordination  state  f(t)  with  its 
neighbors.  Finally,  it  is  assumed  that  the  connectivity  of  the  commu¬ 
nications  graph  TU)  that  captures  the  underlying  bidirectional 
communications  network  topology  of  the  fleet  at  time  t  satisfies  the 
PE-like  condition 

1  1  P+T 

-=  QL(t)Qt  At  >  for  all  f  >  0  (8) 

n  T  J, 

where  L(t )  £  R”xn  is  the  Laplacian  of  the  graph  F( r) ,  and  Q  is  an 
(n  —  1)  X  n  matrix  such  that  Qln  =  0  and  QQT  =  I„_j,  with  1„ 
being  the  vector  in  R"  whose  components  are  all  1 .  The  parameters  T, 
p  >  0  characterize  the  quality  of  service  (QoS)  of  the  communi¬ 
cations  network,  which,  in  the  context  of  this  paper,  represents  a 
measure  of  the  level  of  connectivity  of  the  communications  graph. 
Note  that  the  PE-like  condition  of  Eq.  (8)  requires  only  the 
communications  graph  T(r)  to  be  connected  in  an  integral  sense,  not 
pointwise  in  time.  In  fact,  the  graph  may  be  disconnected  during 
some  interval  of  time  or  may  even  fail  to  be  connected  for  the  entire 
duration  of  the  mission.  Similar  type  of  conditions  can  be  found,  for 
example,  in  [6,51]. 

Using  the  previous  formulation,  one  can  now  define  the  problem  of 
time-critical  cooperative  path  following  for  a  fleet  of  n  UAV s. 


Definition  2  ( time-critical  cooperative  path-following  problem): 
Given  a  fleet  of  n  vehicles  supported  by  an  intervehicle  communi¬ 
cations  network  and  a  set  of  desired  3-D  time  trajectories  pdd(td), 
design  feedback  control  laws  for  pitch  rate  q(t),  yaw  rate  r(f),  and 
speed  v(t)  such  that  1)  all  closed-loop  signals  are  bounded;  2)  for 
each  vehicle  i,  i  £  { I ,  . . . ,  n},  the  path-following  generalized  error 
vector  xpf  ft)  converges  to  a  neighborhood  of  the  origin;  and  3)  for 
each  pair  of  vehicles  i  and  j,  i,j  £  {l...,n},  the  coordination 
error  \f(t)  —  f(t)\  converges  to  a  neighborhood  of  the  origin, 
guaranteeing  (quasi-)simultaneous  time  of  arrival  and  ensuring 
collision-free  maneuvers. 

C.  Unmanned  Aerial  Vehicle  with  Autopilot 

At  this  point,  it  is  important  to  stress  that  this  paper  addresses  the 
design  of  control  algorithms  for  path  following  and  time  coordination 
yielding  robust  performance  of  a  fleet  of  UAV s  executing  various 
time-critical  cooperative  missions.  These  control  algorithms  are 
to  be  seen  as  guidance  outer-loop  controllers  that  provide  reference 
commands  to  inner-loop  autopilots  stabilizing  the  UAV  dynamics 
and  providing  angular-rate  as  well  as  speed-tracking  capabilities. 
This  inner/outer-loop  approach  simplifies  the  design  process  and 
affords  the  designer  a  systematic  approach  to  seamlessly  tailor  the 
algorithms  for  a  very  general  class  of  UAV s  that  come  equipped  with 
inner-loop  commercial  autopilots.  The  design  of  inner-loop  onboard 
autopilots  that  are  capable  of  tracking  reference  commands  generated 
by  outer-loop  controllers  and  providing  uniform  performance  across 
the  flight  envelope  is,  however,  beyond  the  scope  of  the  work 
presented  here.  This  section  presents  a  set  of  assumptions  on  the  inner 
closed-loop  performance  of  the  UAV s  with  their  autopilots,  which 
will  be  useful  to  analyze  the  convergence  properties  of  the  path¬ 
following  and  coordination  control  laws  developed  later  in  the  paper. 

To  this  effect,  and  for  the  purpose  of  this  paper,  it  is  assumed  that 
each  UAV  is  equipped  with  an  onboard  autopilot  designed  to  stabilize 
the  UAV  and  to  provide  angular-rate  as  well  as  speed-tracking 
capabilities.  In  particular,  the  assumption  is  made  that  the  onboard 
autopilots  ensure  that  each  UAV  is  able  to  track  bounded  pitch-rate 
and  yaw-rate  commands,  denoted  here  by  qc(t)  and  rc{t),  with 
guaranteed  performance  bounds  yq  and  yr.  Stated  mathematically. 


1  qc(t)  -  qU)  1  <  j v 

V  t>  0 

(9a) 

1  rc(t)  -  r(t)  1  <  yr. 

V  t>  0 

(9b) 

Similarly,  it  is  assumed  that,  if  the  speed  commands  vc(t)  satisfy  the 
bounds 

t'min  —  t'V.(r)  <  l’m;lx ,  V  T  £  [0,  /]  (10) 

then  the  autopilots  ensure  that  each  UAV  tracks  its  corresponding 
speed  command  with  guaranteed  performance  bound  yv: 

\vc(j)  ~  v(t)\  <  yv,  Vr£[0,  t]  (11) 

The  bounds  yq,  yr,  and  yv  thus  characterize  the  level  of  tracking 
performance  that  the  inner-loop  autopilot  is  able  to  provide.  It  is 
important  to  note  that,  in  this  setup,  it  is  the  autopilot  that  determines 
the  bank  angle  required  to  track  the  angular-rate  commands  qc{t)  and 
rc(t).  Therefore,  it  is  justified  to  assume  that  the  UAV  roll  dynamics 
(roll  rate  and  bank  angle)  are  bounded  for  bounded  angular-rate 
commands  corresponding  to  the  set  of  feasible  paths  considered. 

Remark  1 :  The  bounds  in  Eqs.  (9)  and  (11)  will  be  used  later  in  the 
paper  to  set  constraints  on  the  inner-loop  tracking-performance 
requirements  that  guarantee  stability  of  the  complete  cooperative 
control  architecture.  As  it  will  become  clear  from  the  algorithms  for 
path  following  and  time  coordination  proposed  later,  a  proper  choice 
of  the  boundary  (initial)  conditions  for  the  trajectory-generation 
problem  may  be  required  to  ensure  that  these  bounds  can  be  satisfied 
for  all  times.  A  more  relaxed  (and  realistic)  assumption  would  be 
ultimate  boundedness  of  the  inner-loop  tracking  errors;  under  this 
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assumption,  the  results  in  this  paper  would  still  hold  with  a  few 
modifications,  especially  affecting  the  initial  transient  phase.  For 
simplicity,  however,  we  assume  that  the  performance  bounds  in 
Eqs.  (9)  and  (11)  hold  uniformly  in  time.  From  a  practical 
perspective,  these  performance  bounds  (as  well  as  the  constraints  on 
them  derived  in  the  following  sections)  should  be  seen  as  guidelines/ 
specifications  for  the  design  of  the  inner-loop  autopilots. 


that  the  origin  of  the  kinematic-error  equations  in  Eq.  (6)  is 
exponentially  stable  with  guaranteed  rate  of  convergence 

-  AKp  +  Kr(  1  -  c2) 

v-  2 

~  2  {(Kp  ~  {  ~  c2))2  +  c2(l-  2c2)2  ^")2  (17) 


III.  Three-Dimensional  Path  Following  for  a  Single 
Unmanned  Aerial  Vehicle 

This  section  describes  an  outer-loop  3-D  path-following  nonlinear 
control  algorithm  that  uses  vehicle  angular  rates  to  steer  the  ith 
vehicle  along  the  spatial  path  pd,(-)  for  an  arbitrary  feasible  speed 
profile  (temporal  assignment  along  the  path).  Controller  design 
builds  on  previous  work  by  the  authors  on  path-following  control  of 
small  tactical  UAV s,  reported  in  [43],  and  derives  new  path-following 
control  laws  on  SO(3)  that  avoid  the  geometric  singularities  and 
complexities  that  appear  when  dealing  with  local  parameterizations 
of  the  vehicle’s  attitude  or  quaternions.  First,  only  the  kinematic 
equations  of  the  UAV  are  addressed  by  taking  pitch  rate  and  yaw  rate 
as  virtual  outer-loop  control  inputs.  In  particular,  it  is  shown  that 
there  exist  stabilizing  functions  for  q(t)  and  r(t),  leading  to  local 
exponential  stability  of  the  origin  of  Qe  with  a  prescribed  domain 
of  attraction.  Then,  a  stability  analysis  is  performed  for  the  case 
of  nonperfect  inner-loop  tracking,  and  it  is  shown  that  the  path¬ 
following  errors  are  locally  uniformly  ultimately  bounded  with  the 
same  domain  of  attraction.  The  results  yield  an  efficient  methodology 
to  design  path-following  controllers  for  UAV s  with  due  account  for 
the  vehicle  kinematics  and  the  characteristics  of  their  inner-loop 
autopilots. 

A.  Nonlinear  Control  Design  Using  Unmanned  Aerial  Vehicle 
Kinematics 

Recall  from  Sec.  II.  A  that  the  main  objective  of  the  path-following 
control  algorithm  is  to  drive  the  position  error  pF(t)  and  the  attitude 
error  eF(t)  to  zero.  At  the  kinematic  level,  these  objectives  can  be 
achieved  by  determining  feedback  control  laws  for  q(t),  r(t),  and 
f(t)  that  ensure  that  the  origin  of  the  kinematic-error  equations  in 
Eq.  (6)  is  exponentially  stable  with  a  given  domain  of  attraction. 

To  solve  the  path-following  problem,  let  the  rate  of  progression  of 
point  P  along  the  path  be  governed  by 


?  =  (uw,  +  KfpF)  •  t  (12) 

where  Kf  is  a  positive  constant  gain.  Then,  the  rate  commands  qc(t) 
and  rc(t)  given  by 


—  n rRt (Rp{coF/j}F  +  {a>D/F}D)  ■ 


where  KF  is  also  a  positive  constant  gain,  drive  the  path-following 
generalized  error  vector  x„f(t )  to  zero  with  a  guaranteed  rate  of 
convergence.  A  formal  statement  of  this  result  is  given  in  the  next 
lemma. 

Lemma  1:  Assume  that  the  UAV  speed  v(t)  verifies  the  following 
bounds: 


0  <  umin  <  v(t)  <  umax,  V  t  >  0  (14) 

If,  for  given  positive  constants  c  <  4-  and  C\,  the  path-following 
control  parameters  K(,  K and  d  are  chosen  such  that 


KrKp  >  2 


cf(l  -  2c2)2 


where  Kp  is  defined  as 


K, 


=  mini  Kf,  —  Vm,B  1 
1  (d2  +  c2cf)U 


(15) 


(16) 


then  the  rate  commands  in  Eq.  (13),  together  with  the  law  in  Eq.  (12) 
for  the  rate  of  progression  of  the  virtual  target  along  the  path,  ensure 


and  domain  of  attraction 

nf;  =  J(pF,  R)  G  R3  X  SO(3)|'F (R)  +  1  \\pF\\2  <  c2  <  *|  (18) 

Proof:  A  sketch  of  the  proof  of  this  result,  which  uses  some  insight 
from  [52],  is  given  in  Appendix  B. 

Remark  2:  The  choice  of  the  characteristic  distance  d  in  the 
definition  of  the  auxiliary  frame  V  [see  Eq.  (2)]  can  be  used  to  adjust 
the  rate  of  convergence  for  the  path-following  closed-loop  system. 
This  is  consistent  with  the  fact  that  a  large  parameter  d  reduces  the 
penalty  for  cross-track  position  errors,  which  results  in  a  small  rate  of 
convergence  of  the  UAV  to  the  path.  Insights  into  this  path-following 
control  algorithm  can  be  found  in  [53]. 

B.  Stability  Analysis  for  Nonperfect  Inner-Loop  Tracking 

The  stabilizing  control  laws  in  Eqs.  (12)  and  (13)  lead  to  local 
exponential  stability  of  the  origin  of  the  path-following  kinematic- 
error  dynamics  [Eq.  (6)]  with  a  prescribed  domain  of  attraction.  In 
general,  this  result  does  not  hold  when  the  dynamics  of  the  UAV  are 
included  in  the  problem  formulation.  This  section  presents  a  stability 
analysis  of  the  path-following  closed-loop  system  for  the  case  of 
nonideal  inner-loop  tracking.  In  particular,  it  is  assumed  that  the 
onboard  autopilot  ensures  that  the  UAV  is  able  to  track  bounded 
pitch-rate  and  yaw-rate  commands  with  the  performance  bounds  in 
Eq.  (9)  and  show  that  the  path-following  errors  pF(t)  and  e^(t)  are 
locally  uniformly  ultimately  bounded  with  the  same  domain  of 
attraction  Qc.  The  next  lemma  states  this  result  formally. 

Lemma  2:  Assume  that  the  UAV  speed  v(t)  verifies  the  bounds  in 
Eq.  (14).  For  given  positive  constants  c  <  4-  and  <q ,  choose  the  path¬ 
following  control  parameters  Kf,  KF,  and  d  according  to  the_ design 
constraint  in  Eq.  (15).  Further,  let  V  -  V*1  "  where  Xpf  was 
defined  in  Eq.  ( 17)  and  8X  is  a  positive  constant  verifying  0  <  8X  <  1 . 
If  the  performance  bounds  yq  and  yr  in  Eq.  (9)  satisfy  the  following 
inequality: 

7m  -  ( r\  +  r2r)2  <  2c,,i  \fh  09) 

(1  -  clY 

then,  for  any  initial  state  (pF(0),  R(O))  G  Qc,  the  rate  commands  in 
Eq.  (13),  together  with  the  law  in  Eq.  (12)  for  the  rate  of  progression 
of  the  virtual  target  along  the  path,  ensure  that  there  is  a  time  Tb  >  0 
such  that  the  path-following  errors  pF(t)  and  eF(t)  satisfy 

II e*(0  II2  +  4  IIPf(0  II2  <  f-j—'-T  ll«j?(0)  II2  +  4  II/»f(0)  ||2)  e-^rf', 

C[  V  t  -  c  cj  / 

V0<t<Tb  (20) 


IM0P  +  -4  IIpfWII2  < 


(1  -c2)yl 
UjfS2 


V  t>Tu 


(21) 


Proof:  A  sketch  of  the  proof  of  this  result  is  given  in  Appendix  C. 
Remark  3:  Equations  (20)  and  (21)  show  that  the  path-following 
errors  pF(t)  and  eF(t)  are  uniformly  bounded  for  all  t  >  0  and 
uniformly  ultimately  bounded  with  ultimate  bounds: 


Ik* (Oil  < 


( 1  -  c2)i 


7m, 


IIpfCOII  < 


<q(T  -  c2)i 
^pfdx 


7m - 


v  t>Tb 


Downloaded  by  UNIVERSITY  OF  ILLINOIS  on  April  22,  2013  I  http://arc.aiaa.org  I  DOI:  10.2514/1.56538 


XARGAYETAL. 


505 


These  ultimate  bounds  are  proportional  to  the  inner-loop  tracking 
performance  bound  ym  and,  in  the  limit  ideal  case  of  perfect  inner- 
loop  tracking,  one  recovers  the  exponential  stability  result  derived  in 
Lemma  1. 

Remark  4:  An  implicit  assumption  in  the  previous  derivations  is 
that  the  presence  of  wind  (and  gusts)  does  not  result  in  the  UAV  flying 
at  zero  or  “negative”  ground  speed.  This  assumption  also  holds 
throughout  the  remainder  of  the  paper  for  all  of  the  UAV s  involved  in 
the  cooperative  mission.  In  the  case  of  strong  winds  that  would 
violate  this  assumption,  trajectory  replanning  will  be  required. 


of  the  combined  time-critical  cooperative  path-following  closed-loop 
system  is  proven  and  an  expression  for  the  constant  c2  is  derived. 

Recall  now  that  each  vehicle  is  allowed  to  exchange  only  its 
coordination  parameter  £,(f)  with  its  neighbors  A which  are 
defined  by  the  time-varying  communications  topology.  To  observe 
this  constraint,  the  following  distributed  coordination  law  is 
proposed: 

“coord, 1 U)  =~aYl  (6  ®  -  f/M)  +  1  (26a) 

j'&V  i 


IV.  Time-Critical  Coordination 

The  previous  section  offered  a  solution  to  the  path-following 
problem  for  a  single  vehicle  and  an  arbitrary  feasible  speed  profile  by 
using  a  control  strategy  in  which  the  vehicle’s  attitude-control 
effectors  are  used  to  follow  a  virtual  target  running  along  the  path. 
The  problem  of  time-critical  cooperative  control  of  multiple  vehicles 
is  now  addressed.  To  this  effect,  the  speeds  of  the  vehicles  are 
adjusted  based  on  coordination  information  exchanged  among  the 
vehicles  over  a  time-varying  network.  In  particular,  the  outer-loop 
coordination  control  law  is  intended  to  provide  a  correction  to  the 
desired  speed  profile  vdj  ( • )  obtained  in  the  trajectory-generation  step 
and  to  generate  a  total  speed  command  vc  i(t).  This  speed  command 
is  then  to  be  tracked  by  the  z'th  vehicle  to  achieve  coordination  in  time. 

Recall  from  Sec.  II.B  that  the  main  objective  of  the  time-critical 
cooperative  algorithm  is  to  drive  the  coordination  errors  |  £;(f)  — 
6- (01  to  a  neighborhood  of  the  origin.  To  solve  this  coordination 
problem,  note  that,  from  the  definitions  of  f'd  ,(•)  and  >/,•(•),  it  follows 
that  the  time  derivative  of  the  z'th  coordination  state  can  be 
expressed  as 

m  = 

VdMM) 

Next,  recall  from  the  solution  to  the  path-following  problem  that  the 
evolution  of  the  z'th  virtual  target  vehicle  along  the  path  is  given  by 
tfj  =  (ttjW n  +  KepF  j)  ■  t;,  where  for  simplicity  Ke  has  been  kept 
without  indexing  and  the  dependency  of  the  various  variables  on  t  has 
been  dropped.  The  dynamics  of  the  z'th  coordination  state  can  thus  be 
rewritten  as 


(f/wu  +  KfpFi)  ■  tj 

Vd,i(£i) 


(22) 


At  this  point,  it  is  important  to  remark  that,  if  the  path-following 
control  law  can  guarantee  that,  for  every  UAV,  the  quantity  ( ;  •  t,-) 
is  positive  and  bounded  away  form  zero  for  all  t  >  0,  that  is, 

,■  •  t;  >  c2  >  0,  V  t  >  0.  V  /  €  {1,  ...,/z}  (23) 

where  0  <  c2  <  1 ;  then,  to  solve  the  coordination  problem,  one  can 
use  dynamic  inversion  and  define  the  speed  command  for  the  z'th 
vehicle  as 


vc,i  = 


“coord ^6  P h\i  *  tj 

Wlj  '  t; 


(24) 


where  “COord,i(0  is  a  coordination  control  law,  yet  to  be  defined.  With 
this  speed  command,  the  dynamics  of  the  z'th  coordination  state 
[Eq.  (22)]  can  be  rewritten  as 

•  6  ■ 

*51  =  ^coord,*'  “I  /  *  \  ^l,i  ‘  tj  (25) 


“coord, ;(0  =  -a  Y  (6(0  -  6(0)  +  Xi,i( 0.  i  =  2 . n 

jeMi 

(26b) 

Xu(t)  =  ~b  J2  (6(0  -  6(0).  Xi,i( 0)  =0  '  =  2 . n 


where  vehicle  1  is  elected  as  the  formation  leader  (which  can  be  a 
virtual  vehicle),  and  a  and  b  are  positive  adjustable  coordination 
control  gains.  Note  that  the  coordination  control  law  has  a  pro¬ 
portional-integral  structure,  which  provides  disturbance  rejection 
capabilities  at  the  coordination  level.  Moreover,  note  that  the  vehicles 
exchange  information  only  about  the  corresponding  virtual  targets, 
rather  than  exchanging  their  own  state  information. 

The  coordination  law  in  Eq.  (26)  can  be  rewritten  in  compact 
form  as 


“coal'd (0  —  a -f- 


-  1  - 

- Xi(t )  J 


Xi(t)  =  -bCTL(t)%(t),  Xi,i  (0)  =  1 


(27) 


where  £(0  =  [6(f),  ....  |„(0F>  “COOrd(0  =  [“coord, i(0 . 

“coord, «(0F.  Xi(t)  =  \Xi,i(t) . J/,„(t)F,  cr  =  [0  ],  and 

L(t)  is  the  Laplacian  of  the  undirected  graph  T(f)  that  captures 
the  underlying  bidirectional  communications  network  topology  of 
the  UAV  formation  at  time  t.  It  is  well  known  that  the  Laplacian 
of  an  undirected  graph  is  symmetric,  LT(t)  =  L(t),  and  positive 
semidefinite,  L(t)  >  0;  X\ =0  is  an  eigenvalue  with 
eigenvector  1„,  L(t)  1  „  =  0;  and  the  second  smallest  eigenvalue  of 
L(t)  is  positive  if  and  only  if  the  graph  T(f)  is  connected. 

Next,  the  coordination  problem  stated  previously  is  reformulated 
into  a  stabilization  problem.  To  this  end,  define  the  projection  matrix 
n  as  n  =  I„  -  i  1„  lj,  and  note  that  n  =  Ilr  =  II2  and  also  that 
QTQ  =  II,  where  Q  is  the  (n  —  1)  x  n  matrix  introduced  in  Eq.  (8). 
Moreover,  one  has  that  L(t) II  =  II L(t)  =  L(t),  and  the  spectrum  of 
the  matrix  L(t)  =  QL(t)QT  is  equal  to  the  spectrum  of  L(t)  without 
the  eigenvalue  X\  =  0  corresponding  to  the  eigenvector  1„.  Finally, 
define  the  coordination  error  state  £(f)  =  [£j(f)r,  GUFF  as 

6 (t)  =  Qm  Ci(t)  =  Xi(t)  -  1„— 1 

By  definition,  6  (t)  =  0  is  equivalent  to  f(f)  e  sPan{l«}.  which 
implies  that,  if  f(f)  =  0,  then  all  target  vehicles  are  coordinated  at 
time  t. 

With  the  previous  notation,  the  closed-loop  coordination  dynamics 
formed  by  Eq.  (25)  and  the  coordination  control  algorithm  defined  in 
Eq.  (27)  can  be  reformulated  as 


at)  =  mat)  +  Heat)  (28) 


where  ev  i(t)  =  Vj(t)  —  vc  i(t )  denotes  the  velocity  tracking  error  for 
the  ith  vehicle.  In  what  follows,  it  is  assumed  that  the  bound  in 
Eq.  (23)  holds  for  every  vehicle,  and  a  coordination  control  law 
“coord, i(t)  is  derived  that  achieves  coordination  for  the  entire  fleet  of 
UAV s.  This  assumption  will  be  verified  later  in  Sec.  V,  where  stability 


where  F(t)  e  R(2"  2)x(2n  2)  antj  ^  e  g(2o  2)xh  ^  g(ven  by 


- aL(t )  QC~ 

H  = 

~Q 

_ -bCTQTL(t)  0 

0 
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and  e[,(t)  el"  is  a  vector  with  its  ith  component  equal  to 

Next,  it  is  shown  that,  if  the  connectivity  of  the  communications 
graph  T(0  verifies  the  PE-like  condition  of  Eq.  (8)  and,  in  addition, 
every  vehicle  travels  at  the  commanded  speed  vci(t),  that  is 
e„  ,(f)  =  0,  then  the  coordinated  system  asymptotically  reaches 
agreement  and  all  the  vehicles  travel  at  the  desired  speed 

lim  (|,(f)  -  f -(f))  =  0,  V  ij  e  {1,  .  . . ,  n} 

t — >oo 

lint  |(f)  =  1„ 

t — >CO 

On  the  other  hand,  if  evi{  t)  0  for  some  t  >  0,  then  the  coordination 
error  vector  degrades  gracefully  with  the  size  of  the  speed-tracking 
error  ev(t)  =  [evl  (t),  . . . ,  evn(t)]T.  The  next  lemma  summarizes  this 
result. 

Lemma  5:  Consider  the  coordination  system  of  Eq.  (28)  and 
suppose  that  the  Laplacian  of  the  graph  that  models  the 
communications  topology  satisfies  the  PE-like  condition  of  Eq.  (8) 
for  some  parameters  /r  and  T.  Moreover,  assume  that  the  speed¬ 
tracking  error  vector  ev(t )  is  bounded  for  all  t  >  0.  Then,  there  exist 
coordination  control  gains  a  and  b  such  that  the  system  [Eq.  (28)]  is 
input-to-state  stable  (ISS)  with  respect  to  ev(t),  satisfying 

If (01  <  £illf(0)||e-v  +  k2  sup  ||e„(0||,  V  t  >  0  (29) 

re[0,0 

for  some  positive  constants  k\,  k2  G  (0.  oo),  and  with 
Xc  =  Xc(l  —  Of),  where 

4  =  Lfl";lT,  2d  +  P)~'.  P>2  n,  and  0  <  0X  <  1 

( 1  +  anTY 

Furthermore,  the  coordination  states  <f ;,(f)  and  their  rates  of  change 
ti(0  satisfy 

lim  sup  |f((f)  -  f;(0|  <  h\im  sup  ||e„(f)||  (30) 

t — MX)  t — >00 


lim  sup  |ii(f)  —  1|  <  Aqlirn  sup  ||e„(t)|!  (31) 

t — MX)  t—*  OO 

for  all  i,  jejl . n}  and  for  some  positive  constants  k3, 

A4  G  (0,  oo). 

Proof:  A  sketch  of  the  proof  of  this  result  is  given  in  Appendix  D. 

Remark  5:  Lemma  3  indicates  that  the  QoS  of  the  network 
(characterized  by  parameters  T  and  fY)  limits  the  achievable 
(guaranteed)  rate  of  convergence  for  the  coordination  control  loop. 
According  to  the  lemma,  for  a  given  QoS  of  the  network,  the 
maximum  upper  bound  on  the  (guaranteed)  rate  of  convergence 
X*  is  achieved  by  setting  a*  =  (1  /Tn),  which  results  in  X*  = 
£  (1  +/?)“’.  Also,  it  is  important  to  mention  that,  as  the  parameter  T 
goes  to  zero  (graph  connected  pointwise  in  time),  the  upper  bound  on 
the  convergence  rate  can  be  set  arbitrarily  fast  by  increasing  the 
coordination  control  gains  a  and  b.  This  is  consistent  with  results 
obtained  in  previous  work  by  the  authors  (see  [40],  Lemma  2). 

Finally,  notice  that  jq  =  \an\i/{  1  +  anT)2]  represents  the  upper 
bound  on  the  (guaranteed)  convergence  rate  for  the  coordination  loop 
with  a  proportional  control  law,  rather  than  a  proportional-integral 
control  law  (see  Appendix  D).  It  is  straightforward  to  verify  that,  for  a 
given  proportional  gain  a,  one  has  that  Xc  <  jq,  which  implies  that  a 
proportional  control  law  can  provide  higher  rates  of  convergence  than 
the  proportional-integral  control  law  used  in  this  paper.  However,  as 
mentioned  earlier,  the  integral  term  in  the  coordination  control  law  is 
important  in  the  current  application  because  it  provides  disturbance 
rejection  capabilities  at  the  coordination  level;  see  [54]. 


V.  Combined  Path  Following  and  Time-Critical 
Cooperation 

The  previous  sections  have  shown  that,  under  an  appropriate 
set  of  assumptions,  the  path-following  and  coordination  control 
laws  are  able  to  ensure  stability  and  ultimate  boundedness  of  the 
path-following  and  time-critical  cooperation  problems  when  treated 
separately.  In  particular,  the  solution  developed  for  the  path¬ 
following  problem  assumes  that  the  speed  of  the  UAV  is  bounded 
above  and  below,  while  the  control  law  designed  for  vehicle 
coordination  relies  on  the  assumption  that  the  angle  between  the 
UAV’s  velocity  vector  and  the  tangent  direction  to  the  path  is  less  than 
90  deg;  see  Eqs.  (14)  and  (23).  This  section  addresses  the 
convergence  properties  of  the  combined  cooperation  and  path¬ 
following  systems  and  derives  design  constraints  for  the  inner-loop 
tracking  performance  bounds  that  guarantee  stability  of  the  complete 
system.  The  cooperative  path-following  control  architecture  for  the 
;th  UAV  is  presented  in  Fig.  2. 

In  this  section,  it  is  assumed  that  the  onboard  autopilot  ensures  that 
each  UAV  is  able  to  track  bounded  pitch-rate,  yaw-rate,  and  speed 
commands  with  the  performance  bounds  in  Eqs.  (9) — ( 11).  Note  that, 
although  the  pitch-rate  and  yaw-rate  commands  in  Eq.  (13)  are 
continuous  in  time,  the  same  cannot  be  said  about  the  speed 
command  in  Eq.  (24).  In  fact,  because  of  the  time-varying  nature  of 
the  network  topology,  the  coordination  law  ucnm&(t)  in  Eq.  (26)  is 
discontinuous,  which  implies  that  the  speed  command  vc(t)  is  also 
discontinuous.  Assuming  that  the  following  bound  holds  for  all 
vehicles  and  for  all  t  >  0, 

|t >c,i(0  ~  UWI  <yv,  i  =  1 . n  (32) 

which  implies  that  supr>0  ||et,(0l!  ^  sf^Yv  then  the  maximum 
amplitude  Avc  ,■  of  a  jump  in  the  speed  command  vc  i(t)  can  be 
derived  from  Eqs.  (24)  and  (26)  and  the  results  of  Lemma  3  and  is 
given  by 

A  2a(n  —  l)u,i,!max(&1||?(0)||  +  k2^fnyf)  . 

Avc  j  = - ,  i  =  1 . n 

Cl 

where  vd  i  max  was  introduced  in  Eq.  (7).  Thus,  a  necessary  (but  by  no 
means  sufficient)  condition  for  the  bound  in  Eq.  (32)  to  hold  is  that 

<yv>  i  =  1-  •  •  •>» 

The  previos  condition  limits  the  choice  of  the  coordination  control 
gains,  which  in  particular  need  to  satisfy  the  following  inequality 

2 a(n  -  l)vd  i  maxk2y/n  <  c2,  i=  1 . n 

However,  the  derivation  of  sufficient  conditions  that  guarantee  that 
the  bound  in  Eq.  (11)  holds  for  all  time  requires  assumptions  on 


Fig.  2  Time-critical  cooperative  path-following  closed-loop  for  the  ith 
vehicle. 
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vehicle  dynamics  and  autopilot  design  and  is  thus  beyond  the 
scope  of  this  paper.  Hence,  for  the  subsequent  developments,  the 
assumption  is  made  that  the  bound  in  Eq.  (11)  holds,  provided  that 
the  speed  command  vci(t)  satisfies  the  bounds  in  Eq.  (10),  and  design 
constraints  for  this  inner-loop  tracking  performance  bound  are 
derived  that  ensure  that  the  overall  time-critical  cooperative  path¬ 
following  control  system  is  stable  and  has  desired  convergence 
properties.  The  next  theorem  summarizes  this  result. 

Theorem  1:  Consider  a  fleet  of  n  UAVs  supported  by  a 
communications  network  that  satisfies  the  PE-like  condition  in 
Eq.  (8).  Let  c  and  cx  be  positive  constants,  with  c  <  (l/\/2)  and 
C\  <  (E/c).  For  each  UAV,  choose  the  path-following  control 
parameters  Ke,  K and  d  such  that 


d> 


2c(l  —  c2)'2 
1  -  2c2  Cl 


IS  IS  _ 1Ilax _ 

*  '  >  c2(l  _  2c2)2 


(33) 


where  Kp  is  defined  as  in  Eq.  (16).  Also,  choose  the  coordination 
control  gains  a  and  b  such  that 


a  >  0, 


2n  an/x 
2  n  +  1  (1  +  anT )2 


b  anu 

<-< - - - ~ 

a  (1  +  anT)~ 


(34) 


and  let  kx  and  k2  be  the  constants  in  Eq.  (29)  for  this  particular  choice 
of  control  gains  a  and  b.  Further,  let  the  performance  bounds  yq,  yr, 
and  yv  satisfy  the  following  inequalities: 

(fq  +  if)2  <  ..  2C,.i^pA  (35) 

(1  -  tr) 2 


.  ■  /  vmaxc2  _  vd  max  _  KfCC r  Vd  min  -  Vmin  -  K^CCi 

yv  <  min  - = - — - , - = - — — 

V  c2  +  k2  Vd  max  V«  1  +  k2vd  max  V™ 

where  S2  is  a  constant  satisfying  0  <  S2  <  1,  vdmdx  = 
maxi=i,...,nvd,i  max,  vd  min  =  minf=li . . . vdd  min,  while  c2  and  L 
are  defined  as  c2  =  [d(\  —  2c2)  —  2ciC2(1  —  c2)*]/[(rf2  +  c2c2)*] 
and  k2  =  (2 a(n  —  1)  +  1  )k2.  Then,  the  progression  law  in  Eq.  (12), 
the  rate  commands  in  Eq.  (13),  and  the  speed  commands  in  Eq.  (24) 
with  the  coordination  control  law  in  Eq.  (26)  ensure  that,  for  all  initial 
conditions 


(Pf/OliitOHefl,  i=  1 . 


(37) 


Iff 

=  min  < 

C|  V  l 


iiao)ii<7 

k 


-  k2  s/nyv  - 


t^max  f  v  ,  tyi  min  tlmjn  4 ‘  yv 

- C2  -  1, - 

Vd  max  Vd  max  Vd  max 


KfCC^ 

vd  max  ) 


(38) 


where  k\  =  (2 a(n  —  1)  +  l)fc],  there  exist  times  Tb  i  >  0  and  a 
positive  constant  lc  such  that  the  path-following  errors  pF  i(t )  and 
eF  j(t)  for  the  ith  UAV  satisfy 


lkiu(0ll2  +  4llPA.(0ll2 

CT 

<  iiefi,4°)ii2 + ^ 

V  0  <  t  <  Tbd  (39) 


\\eR,i(t)\\2  +  -^WPfAM2  <  (1 


■  c2)rl 


4 


Vt>Th 


(40) 


IICMII  <  ktWmWe-^  +  k2Vnyv,  V  t  >  0  (41) 

Proof:  A  sketch  of  the  proof  of  this  result  is  given  in  Appendix  E. 

Remark  6:  The  previous  lemma  shows  that,  if  the  initial  conditions 
for  each  UAV  satisfy  Eq.  (37),  then  the  UAV s  remain  inside  tubes  of 
radii  cci  centered  at  the  corresponding  desired  paths  during  the  entire 
duration  of  the  mission.  The  bound  C!  <  E/c,  where  E  is  the  spatial 
clearance  between  paths  introduced  at  the  beginning  of  Sec.  II, 
ensures  that  these  tubes  do  not  intersect  and,  hence,  the  UAV s  do  not 
collide.  In  the  case  of  collision  avoidance  in  time  (see  [44]),  the  bound 
on  Ci  is  more  involved  and  accounts  for  both  path-following  and 
coordination  errors. 

Remark  7:  Equations  (39, 40)  show  that  the  path-following  errors 
Ppiit)  and  e  p  ft)  are  uniformly  bounded  for  all  t  >  0  and  uniformly 
ultimately  bounded  with  ultimate  bounds 


K,v)ii  < 

IbtvWII  < 


( i  -  c2)( 

2 kpfd,  Ym' 

c  i  ( 1  —  c2)^ 

2  lpfS2  Ya 


V  f  >  Tb, 


V  /'  e  {1 . n} 


which  are  proportional  to  the  inner-loop  tracking  performance  bound 
yw.  On  the  other  hand,  Eq.  (41)  implies  that  the  coordination  error 
state  f(t)  converges  exponentially  fast  to  a  neighborhood  of  the 
origin  with  radius  proportional  to  the  inner-loop  speed-tracking 
performance  bound  yv.  This  implies  that,  in  the  limit  case  of  perfect 
inner-loop  tracking,  the  path-following  errors  of  each  vehicle  and  the 
coordination  error  state  vector  converge  exponentially  fast  to  zero. 

Remark  8:  The  design  constraint  in  Eq.  (36)  requires  a  sufficiently 
large  margin  between  vd  max  and  i>max  and  between  vd  min  and  i>min. 
This  can  be  achieved  by  directly  imposing  tighter  feasibility 
constraints  on  vehicle’s  speed  in  the  formulation  of  the  trajectory- 
generation  problem;  see  [44]. 


VI.  Cooperative  Road  Search  with  Multiple 
Unmanned  Aerial  Vehicles 

This  section  presents  flight-test  results  for  a  cooperative  road- 
search  mission  that  show  the  efficacy  of  the  multi-UAV  cooperative 
framework  presented  in  this  paper.  The  significance  of  these 
experiments  is  twofold.  First,  the  flight-test  results  verify  the  main 
stability  and  convergence  properties  of  the  developed  cooperative 
algorithms  in  a  realistic  mission  scenario,  under  environmental 
disturbances  and  with  the  limitations  of  a  real-world  communications 
network.  And  second,  the  results  demonstrate  the  usefulness  and 
validity  of  the  proposed  generic  theoretical  framework  in  a  specific 
realistic  application  as  well  as  the  feasibility  of  the  onboard 
implementation  of  the  algorithms.  More  flight  tests  are  scheduled  in 
2013  to  conduct  a  more  thorough  verification  of  the  theoretical 
findings  of  this  paper. 


while  the  coordination  error  states  f  (f)  satisfy 


Fig.  3  The  concept  of  coordinated  road  search  using  multiple  UAVs. 
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a)  SIG  Rascal  110  research  aircraft 
Fig.  4 


c)  Full-motion  video  camera 
SIG  Rascal  UAV  with  two  different  onboard  cameras. 


a)  Desired  three-dimensional  spatial  paths 


b)  Two-dimensional  projections 


■S  20 


- Speed  UAV  1 

- Speed  UAV  2 

transition  road  search 

50  100 

desired  mission  time,  td  (s) 


c)  Desired  speed  profiles 


Fig.  5  Coordinated  road-search  trajectory  generation. 


A.  Mission  Description 

One  of  the  applications  that  motivates  the  use  of  multiple 
cooperative  UAV s  and  poses  several  challenges  to  systems  engineers, 
both  from  a  theoretical  and  practical  standpoint,  is  automatic  road 
search  for  improvised  explosive  device  detection;  see  Fig.  3.  It  is 
envisioned  that  the  mission  is  initiated  by  a  minimally  trained  user 
who  scribbles  a  path  on  a  digital  map,  generating  a  precise  continuous 
ground  track  for  the  airborne  sensors  to  follow.  This  ground 
track  is  then  transmitted  over  the  network  to  a  fleet  of  small  tactical 
UAV s  equipped  with  complementary  visual  sensors.  An  optimization 
algorithm  generates  feasible  collision-free  flight  trajectories  that 
maximize  road  coverage  and  account  for  sensor  capabilities  (field  of 


view,  resolution,  and  gimbal  constraints)  as  well  as  intervehicle  and 
ground-to-air  communications  limitations.  Maximization  of  the  road 
coverage  by  two  complementary  sensors  is  the  high-level  mission 
objective  in  this  scenario.  The  fleet  of  UAVs  then  starts  the 
cooperative  road  search.  During  this  phase,  the  information  obtained 
front  the  sensors  mounted  onboard  the  UAVs  is  shared  over 
the  network  and  retrieved  by  remote  users  in  near  real  time.  The 
explosive  device  detection  can  thus  be  done  remotely,  based  on  in  situ 
imagery  data  delivered  over  the  network. 

In  this  particular  mission  scenario,  a  robust  cooperative  control 
algorithm  for  the  fleet  of  UAV s  can  improve  mission  performance 
and  provide  reliable  target  discrimination  by  effectively  combining 
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a)  Normalized  coordination  states 


b)  UAV  speeds 


time  (s) 


c)  Normalized  coordination  error 


d)  Intervehicle  separation 

Fig.  6  Time  coordination  during  the  transition  phase. 


the  capabilities  of  the  complementary  onboard  sensors.  In  fact,  flying 
in  a  coordinated  fashion  is  what  allows  maximizing  the  overlap 
of  the  fields  of  view  (FOVs)  of  multiple  sensors  while  reliably 
maintaining  a  desired  image  resolution.  Furthermore,  this  autono¬ 
mous  multivehicle  cooperative  approach  can  potentially  reduce 
the  number  of  operators  involved  in  the  mission  as  well  as  their 
workload. 

B.  Airborne  System  Architecture 

The  small  tactical  UAVs  employed  in  this  mission  are  two  SIG 
Rascals  110  s  operated  by  the  Naval  Postgraduate  School;  see  Fig.  4. 
The  two  UAV s  have  identical  avionics  and  instrumentation  onboard, 
the  only  difference  being  the  vision  sensors.  The  first  UAV  has  a  one- 
degree-of-freedom  bank-stabilized  high-resolution  12  MP  camera, 
while  the  second  UAV  has  a  full-motion  video  camera  suspended 
on  a  two-degree-of-freedom  pan-tilt  gimbal.  Because  of  weight  and 
power  constraints,  each  UAV  is  allowed  to  carry  only  one  camera  at  a 
time,  and  therefore  the  two  cameras  need  to  be  mounted  on  different 
platforms.  The  rest  of  the  onboard  avionics,  common  to  both 
platforms,  includes  two  PC-104  industrial  embedded  computers111 
assembled  in  a  stack,  a  wireless  mobile  ad  hoc  network  (MANET) 
link* * ***,  and  the  Piccolo  Plus  autopilot^  with  its  dedicated  900  MHz 
command  and  control  channel. 


1nlData  available  online  at  http://www.adl-usa.com/products/cpu/index.php 

[rehived  30  March  2012], 

***Data  available  online  at  http://www.persistentsystems.com  [retrived 
30  March  2012], 

“"Data  available  online  at  http://cloudcaptech.com  [retrived  30  March 
2012], 


The  first  PC- 104  computer  runs  the  cooperative-control 
algorithms  in  hard  real  time  at  100  Hz.  The  computer  directly 
communicates  with  the  Piccolo  Plus  autopilot  at  50  Hz  over  a 
dedicated  bidirectional  serial  link.  The  second  PC- 104  acts  as  a 
mission  management  computer  that  implements  a  set  of  non-real- 
time  routines  enabling  onboard  preprocessing  and  retrieval  of  the 
sensory  data  (high-resolution  imagery  or  video)  in  near-real  time  over 
the  network.  Integration  of  the  MANET  link  allows  for  robust 
transparent  intervehicle  and  ground  communication,  which  is  needed 
for  both  the  coordination  algorithms  and  the  expedited  sensory  data 
delivery  to  a  remote  mission  operator.  In  fact,  the  MANET  link 
provides  “any-to-any”  connectivity  capability,  allowing  every  node 
(vehicle  or  ground  station)  to  securely  communicate  directly  with 
every  other  node.  Details  on  the  flight-test  architecture  and  the 
supporting  network  infrastructure  for  coordination  control  and  data 
dissemination  can  be  found  in  [55]. 

C.  Flight-Test  Results 

The  flight-test  results  for  a  cooperative  road-search  mission 
executed  by  the  two  SIG  Rascal  UAVs  are  presented  next.  The 
objective  of  the  mission  is  to  detect  a  stationary  or  moving  target  on  a 
given  road.  The  imagery  data  obtained  by  the  UAV s  during  the  road 
search  is  to  be  shared  over  a  MANET  link  so  that  it  can  be  retrieved  by 
remote  operators  in  near  real  time.  Success  of  the  mission  relies  on  the 
ability  to  overlap  the  footprint  of  the  FOVs  of  the  two  cameras  along 
the  road,  which  increases  the  probability  of  target  detection  [56].  For 
the  sake  of  clarity,  in  the  following  description,  the  execution  of  the 
coordinated  road  search  is  divided  into  three  consecutive  phases: 
namely  initialization,  transition,  and  road  search.  The  description  is 
supported  by  one  of  the  flight-test  results  performed  during  a  Tactical 
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Target  detection 
at  178  s 


■  UAV  1 

■  UAV  2 
Desired 
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time  (s) 
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a)  Normalized  coordination  states 


b)  UAV  speeds 


time  (s) 


time  (s) 


c)Normalized  coordination  error 
Fig.  7 


d)  Intervehicle  separation 

Cooperative  path-following  control  during  the  road-search  phase. 


Network  Testbed  field  experiment  at  Camp  Roberts,  CA;  see 
Figs.  5-8.  These  experimental  results  build  on  the  ones  reported  in 
[44]  by  analyzing  in  greater  detail  the  performance  of  the  cooperative 
algorithms  during  the  road-search  phase. 

In  the  initialization  phase,  an  operator  specifies  on  a  digital  map  the 
road  of  interest.  Then,  a  centralized  optimization  algorithm  generates 
road-search  suboptimal  paths  and  desired  speed  profiles  for  the  two 
UAV s  that  explicitly  account  for  UAV  dynamic  constraints,  collision- 
avoidance  constraints,  and  mission-specific  constraints  such  as 
intervehicle  and  vehicle-to-ground  communications  limitations  as 
well  as  sensory  capabilities.  In  particular,  for  this  mission  scenario, 
the  trajectory-generation  algorithm  is  designed  to  maximize  the 
overlap  of  the  footprints  of  the  FOVs  of  the  high-resolution  camera 
and  the  full-motion  video  during  the  road  search,  while  at  the  same 
time  minimizing  gimbal  actuation.  In  addition  to  the  road-search 
paths  and  the  corresponding  desired  speed  profiles,  the  outcome  of 
the  trajectory-generation  algorithm  includes  a  sensor  trajectory  on  the 
ground  to  be  followed  by  the  vision  sensors.  The  two  road-search 
paths  and  the  sensor  path,  along  with  the  three  corresponding  speed 
profiles,  are  then  transmitted  to  the  UAV s  over  the  MANET  link. 

In  the  transition  phase,  the  two  UAVs  fly  from  their  standby 
starting  positions  to  the  initial  points  of  the  respective  road-search 
paths.  For  this  purpose,  decentralized  optimization  algorithms 
generate  feasible  collision-free  3-D  trajectories  that  start  at  the  UAVs’ 
standby  positions  and  satisfy  simultaneous  arrival  to  the  initial  points 
of  the  road-search  paths.  Once  these  transition  trajectories  are 
generated,  the  two  vehicles  start  operating  in  cooperative  path¬ 
following  mode.  From  that  moment  on,  the  UAVs  follow  the 


transition  paths  while  adjusting  their  speeds  based  on  coordination 
information  exchanged  over  the  MANET  link  to  achieve  simulta¬ 
neous  arrival  at  the  starting  point  of  the  road-search  paths.  The 
transition  and  road-search  paths  obtained  for  this  particular  mission 
scenario,  together  with  the  corresponding  desired  speed  profiles,  are 
shown  in  Fig.  5.  Figure  6  illustrates  the  performance  of  the 
coordination  control  algorithm  during  the  transition  phase  of  the 
mission.  As  can  be  observed,  the  intervehicle  separation  remains 
above  100  m  and  the  coordination  error  remains  below  13%  during 
the  entire  duration  of  the  transition  phase,  with  an  11%  error  in 
coordination  at  the  end  of  this  phase. 

Finally,  the  third  phase  addresses  the  cooperative  road-search 
mission  itself,  in  which  the  two  UAV s  follow  the  road-search  paths 
generated  in  the  initialization  phase  while  adjusting  their  speeds  to 
ensure  the  required  overlap  of  the  FOV  footprints  of  the  cameras.  In 
this  phase,  a  target  vehicle  running  along  the  sensor  path  is  virtually 
implemented  on  one  of  the  UAVs.  For  this  road-search  mission,  a 
natural  choice  for  this  sensor  path  is  the  road  itself,  and  this  virtual 
vehicle  thus  determines  the  spot  of  the  road  being  observed  by  the 
vision  sensors  mounted  onboard  the  UAVs  at  a  given  time.  This 
virtual  vehicle  is  indeed  used  as  a  leader  in  the  coordination 
algorithm,  and  its  speed  is  also  adjusted,  based  on  the  coordination 
states  of  the  two  UAV s.  The  coordination  state  of  this  virtual  vehicle 
is  also  transmitted  over  the  network  and  used  in  the  coordination 
control  laws  of  the  two  “real”  vehicles.  The  performance  of  the 
cooperative  path-following  control  algorithm  is  illustrated  in  Fig.  7. 
For  this  particular  scenario,  the  path-following  cross-track  errors 
converge  to  a  3  m  tube  around  the  desired  spatial  paths,  while  the 
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Fig.  8  Mission  performance:  FOV  overlap  and  range  to  the  virtual  vehicle  on  the  sensor  path. 


coordination  errors  remain  below  7  %  during  the  entire  duration  of  the 
road  search.  It  is  worth  noting  that  significant  data  dropouts  occurred 
between  145  s  and  170  s,  especially  effecting  UAV1;  these  data 
dropouts  cause  sudden  jumps  in  the  normalized  coordination  states, 
as  can  be  seen  in  Figs.  7a  and  7c.  The  road-search  phase  ends  at  178  s, 
when  a  target  is  detected  on  the  road.  Upon  detection,  the  two 
UAVs  immediately  switch  to  cooperative  vision-based  target¬ 
tracking  mode.  Flight-test  results  for  this  target-tracking  phase  are  not 
included  here  and  can  be  found  in  [44], 

As  mentioned  previously,  maintaining  a  tight  coordination  along 
the  paths  is  important  to  ensure  a  desired  level  of  FOV  overlap  with 
desired  image  resolution,  two  key  elements  for  reliable  target 
detection.  Figure  8  illustrates  the  performance  of  the  road-search 
mission  from  this  perspective.  One  one  hand,  Fig.  8a  shows  a  set  of 
estimates  of  the  ground  FOV  footprint,  assuming  a  flat  Earth  with 
known  ground  elevation.  These  estimates  assume  a  trapezoidal 
footprint  and  are  based  on  experimental  data  including  the  inertial 
position  and  orientation  of  the  two  UAVs,  orientation  of  their 
cameras,  and  the  line-of-sight  range  to  the  ground.  To  provide  a 
quantitative  measure  of  the  FOV  overlap,  Fig.  8b  presents  an  image- 
overlap  coefficient,  sampled  at  1  Hz.  This  coefficient  is  calculated 
offline  using  proprietary  technology***  and  is  based  on  semi- 
automated  alignment  and  differencing  of  two  synchronous  images. 
As  can  be  seen,  except  for  a  5  s  initial  transient,  the  overlap  coefficient 
stays  above  0.7  during  the  cooperative  road  search.  This  figure  also 
includes  a  side-by-side  image  comparison  of  the  imagery  data 
obtained  from  the  two  cameras  at  approximately  160  s  after  initiation 
of  the  mission;  one  can  easily  observe  that  the  two  images  correspond 


***Data  available  online  at  http://perceptivu.com/TargetTrackingSoftware 
.html  [retrived  4  September  2012], 


to  the  same  road  segment.  On  the  other  hand,  Fig.  8c  shows  the  range 
for  the  two  vision  sensors  to  the  virtual  vehicle  on  the  sensor  path; 
these  ranges  are  always  below  1000  m  for  UAV1  and  500  m  for 
UAV2,  therefore  ensuring  desired  image  resolution  for  the  targets  of 
interest  given  the  characteristics  of  the  two  cameras. 

In  summary,  the  results  presented  previously  demonstrate 
feasibility  and  efficacy  of  the  onboard  integration  of  the  nonlinear 
path-following  and  time-critical  coordination  algorithms.  This 
cooperative  control  approach  applies  to  teams  of  heterogeneous 
systems  and  does  not  necessarily  lead  to  swarming  behavior,  which  is 
unsuitable  for  many  of  the  mission  scenarios  envisioned  in  this 
research.  At  the  same  time,  the  achieved  functionality  of  the  UAV 
following  3-D  curves  in  an  inertial  space  outperforms  the 
conventional  waypoint  navigation  method  typically  implemented 
on  off-the-shelf  commercial  autopilots.  These  results  provide  also  a 
roadmap  for  further  development  and  onboard  implementation  of 
advanced  cooperative  algorithms. 

VII.  Conclusions 

This  paper  addressed  the  problem  of  multiple  unmanned  aerial 
vehicle  (UAV)  cooperative  control  in  the  presence  of  time-varying 
communications  networks  and  stringent  spatial/temporal  constraints. 
The  constraints  involve  collision-free  maneuvers  and  simultaneous 
times  of  arrival  at  desired  target  locations.  The  methodology 
proposed  in  the  paper  built  on  previous  work  by  the  authors  on 
cooperative  path  following  and  extended  it  to  a  very  general  setting 
that  allows  for  the  consideration  time-critical  specifications  and  time- 
varying  communications  topologies.  In  the  setup  adopted,  single¬ 
vehicle  path-following  control  in  three-dimensional  space  was  done 
by  resorting  to  a  nonlinear  control  strategy  derived  at  the  kinematic 
level.  Decentralized  multiple-vehicle  time-critical  cooperative  path 
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following  was  achieved  by  adjusting  the  speed  of  each  vehicle  about  a 
nominal  speed  profile,  in  response  to  information  exchanged  with  its 
neighbors  over  a  dynamic  communications  network.  The  proposed 
approach  addressed  explicitly  the  situation  where  each  vehicle 
transmits  only  its  coordination  state  to  only  a  subset  of  the  other 
vehicles,  as  determined  by  the  communications  topology  adopted. 
Furthermore,  the  paper  considered  the  case  where  the  communica¬ 
tions  graph  that  captures  the  underlying  communications  network 
topology  is  disconnected  during  some  interval  of  time  or  even  fails  to 
be  connected  for  the  entire  duration  of  the  mission,  and  it  provided 
conditions  under  which  the  complete  coordinated  path-following 
closed-loop  system  is  stable  and  yields  convergence  of  conveniently 
defined  cooperation  error  states  to  a  neighborhood  of  the  origin.  The 
paper  also  derived  lower  bounds  on  the  convergence  rate  of  the 
collective  dynamics  as  a  function  of  the  quality  of  service  of  the 
intervehicle  communications  network.  Flight  tests  of  a  coordinated 
road-search  mission  scenario  that  exploited  the  multi-UAV 
cooperative  control  framework  exposed  in  the  paper  demonstrated 
the  efficacy  of  the  algorithms  developed.  Future  work  will  aim  at 
extending  the  algorithms  presented  to  other  kinds  of  vehicles  and 
maneuvers  (e.g.,  quadrotor  UAVs  undergoing  complex  time-critical 
maneuvers  that  require  synchronization  of  attitude  and  position). 

Appendix  A:  Hat  and  Vee  Maps 

The  hat  map  (-)A :  R3  ->  so(3)  is  defined  as 


The  rate  commands  of  Eq.  (13),  together  with  the  law  of  Eq.  (12)  for 
the  rate  of  progression  of  the  virtual  target  along  the  path,  lead  to 

2 

V pf  =  -2KFeF  ■  eF  +  -^(-Ke(pF  ■  t)-  -  pF  ■  (o>f//  X  pF) 
c\ 

+  vpF  ■  (w,  -  (w,  ■  t)t)) 

2 Kf  .  2v 

=  ~2KReR  '  eR - 2 ~XF  ^ j(PF  '  (Wl  -  (W,  ■  t)t)) 

ci  ci 

Let  px(t)  =  y^-(?)n! (f)  +  zF(t)n2(t)  denote  the  cross-track  error, 
and  note  that,  within  set  Qc,  the  following  bounds  hold: 

0  <  1  -  2c2  <  1  -  2'V(R)  =  (w,  ■  b1D)  <  1, 

IIPxll  <  IIpfII  <  «t 

From  these  bounds,  together  with  the  assumption  on  the  UAV  speed 
in  Eq.  ( 14),  it  can  be  proven  that 


V  ^  i  ii  2  2^f  9  2^min 

Vf  —  ~2TXF  9/72  ,  9  2\i 

ci  c\(d2  +  c2cf)  2 


ilbxll2 


2un 


cf(l  -  2c2) 


IIPxlllIwi  X(w,  xb1D) 


MA  = 
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*3 


-x3 
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L  —x2  Xi 


*2  ' 
-Xi 

0  _ 


for  jr  =  [x ! ,  x2 ,  x3Y  G  R3.  The  inverse  of  the  hat  map  is  referred  to  as 
the  vee  map  ( -) v :  so (3)  -*■  R3.  A  property  of  the  hat  and  vee  maps 
used  in  this  paper  is  given  next: 


tr[M(x)A]  =  —x  •  (M  -  MtY  (A1 ) 


Then,  noting  that  || wx  X  (wj  X  b1£))||  =  2||e,d|,  it  follows  that 


2  K, 


2v„ 


Vpf  <  -2KF\\eF\\2  -  -3--AF  -  ,  llFxll 


cj(d2  +  c2c2)t 


Ibx 


4un 


cf(l  -  2c2) 


IIpxIIIM 


Letting  Kp  = 
one  finds 


-  min  |  Ke,  ,  1  and  noting  that  ||px||  <  \\pFg 

(  (d2+C2C2l)’Z ) 


for  any  x  G  R3,  and  M  G  R3x3.  The  reader  is  referred  to  [52]  for 
further  details  on  the  hat  and  vee  maps. 


vpf<- 


-2  Kk 


9  K 

\eF\\2-^\\pF\\2  + 


4vn 


cf(  1  -  2c2) 


IIPFlllk«|| 


Appendix  B:  Sketch  of  the  Proof  of  Lemma  1 

First,  note  that,  over  the  compact  set  Q.c  introduced  in  Eq.  (18),  the 
following  upper  bounds  hold: 


From  the  choice  for  the  characteristic  distance  d  and  the  path¬ 
following  control  parameters  K?  and  KF  inEq.  (15)  and  the  definition 
of  2pf  in  Eq.  (17),  it  follows  that 


IIPfII  -  cct 

'V(R)  <  c2  <  ' 


(Bl) 

(B2) 


'  Kr 

Dmax 

l)max  “| 

Cj(l-2c2) 
kp 

-  Kf 

Ol 

o  -4 

cj(l-2c2) 

C 2 

C1  J 

cf 

which  implies  that,  within  set  Q.c,  the  following  bound  holds: 


Consider  now  the  Lyapunov  function  candidate 
Vpf(PF,R)  =  'i'(R)+^\\pF\\2 

ct 

This  function  is  locally  positive-definite  about  ( pF,Rn )  =  (0,1) 
within  region  £lc  defined  in  Eq.  (18).  Moreover,  note  that  |[e^||2  = 
*P(/j)(l  _  'T(ff))  and,  then,  the  bound  in  Eq.  (B2)  implies  that,  inside 
set  the  Lyapunov  function  V pf  can  be  bounded  as 

IM2  +  —  IIpfII2  ^  vpf  <  - — j  Ikjjlh  +  —  IIpfII2  <B3) 

cy  re  c  y 


From  Eqs.  (1)  and  (5),  the  time  derivative  of  Vpf  along  the 
trajectories  of  the  system  is  given  by 

Vpf  =  eR  '  ~  n rRt (Rf{cof/i}f  +  {cuo/fL)^ 

2 

H — j Pf  ■  (— —  o)p/i  X  pp  +  v\V\) 


Vpf  <  ~2Xpf(^-  —  ,  || II 2  +^2  [IPfII2^  <  ~22pfVpf 

It  follows  from  [57]  (Theorem  4.10)  that  both  ||e^||  and  ||/>f[! 
converge  exponentially  to  zero  for  all  the  initial  conditions  inside  the 
compact  set  Qc.  □ 


Appendix  C:  Sketch  of  the  Proof  of  Lemma  2 

First,  it  is  shown  that  the  rate  commands  qc{t)  and  rc(t )  are 
bounded  for  all  (pF,eF)  G  Qc.  To  this  end,  note  that,  over  the 
compact  set  Qc,  which  was  introduced  in  Eq.  (18),  the  following 
inequalities  hold: 


IIPfII  <  cc1(  f(i)<c2 

These  bounds,  together  with  the  bound  on  the  UAV  speed  in  Eq.  ( 14) 
and  the  assumption  on  the  feasibility  of  the  path,  can  be  used  to  show 
that,  for  all  (pF,eF)  G  £2C,  the  rate  commands  qc(t)  and  rc(t)  are 
bounded.  Then,  based  on  the  assumption  made  in  Sec.  II.C  on  the 
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tracking  capabilities  of  the  UAV  with  its  autopilot,  one  has  that,  for  all 
(pF,  e p)  e  Q.c ,  the  following  performance  bounds  hold: 

\<lc-q\<7q,  \rc-r\<jr  (Cl) 


Next,  consider  again  the  Lyapunov  function  candidate 

Vpf{pF,R)  =  '¥(R)+\\\pF\\2 
ci 

From  Eqs.  ( 1 )  and  (5),  the  time  derivative  of  Vpf  along  the  trajectories 
of  the  system  can  be  expressed  as 

-  HRRT(Rp{coF/i}F  + 

+  Of  Pf  '  (-  A  -  mF/I  XPF+  wO  -  e K  ■ 
c\ 

Similar  to  the  proof  of  Lemma  1,  one  has  that,  inside  set  Q.c,  the 
following  bound  holds: 

Vpf  <  -2Xpf(j±^\\e$  +  4|IpfII2)  +  IM 

where  A pf  was  defined  in  Eq.  (17).  From  the  performance  bounds  in 
Eq.  (Cl)  and  the  definition  of  ym  in  Eq.  (19),  it  follows  that 


which  leads  to 

v pf  ^  Hg? II2  +  ^2  IIPfII2^  +  lle«llf<» 

The  previous  inequality  can  now  be  rewritten  as 


Vpf  <  —2Apf(\  -  <5,0  ^  _  c2  llG?ll“  +  IIPfII2  j 

-  2APfSx^j—^j  HcfII2  +  ^2  IIpfII2]  +  lle«ll/<» 

where  0  <  5^  <  1.  Then,  for  all  pF(0  and  ep(t)  satisfying 

-2ApfSz [|e^||2  +  ~2  IIpfII2  j  +  ll^llra,  ^  0  (C2) 

one  has 

Vpf  <  -2Apf(l  Nil2  +  ^IIPfII2) 

<-2Apf(l-8x)Vpf 


The  inequality  in  Eq.  (C2)  is  satisfied  outside  the  bounded  set  D 
defined  by 


M 


D=  U pf.R )  e  R3  x  SO(3)| 


lk*ll 


+  —  IIpfII 


(i  -c2)rl 
16 XpfSl 


( I  -  c2)y„A  2 

4 ApfSf  ) 


One  can  prove  that  set  D  is  in  the  interior  of  the  compact  set  Slb 
defined  by 


£2,  4  j (PF.  R)  e  R3  x  SO(3)|T(«)  +  4  IIpfII2  <  (1 

v  ci  4APf°l 

Then,  the  design  constraint  for  the  performance  bounds  yq  and  yr  in 
Eq.  (19)  implies  that  set  Qb  is  in  the  interior  of  set  Q.c  introduced  in 
Eq.  (18),  that  is  Q.b  C  £2f. 

With  the  previous  results  and  using  a  proof  similar  to  that  of 
Theorem  4.18  in  [57],  it  can  be  shown  that,  for  every  initial  state 
(pF(0),R(0))  e  £2f,  there  is  a  time  Tb  >  0  such  that  the  following 
bounds  are  satisfied: 


Vpf{t)  <  Vpf( Oje-2^1-^)',  V  0  <  t  <  Tb, 


Vpf(t) 


(i  -  c2)rl 

42p/<52 


V  t>Tb 


The  bounds  in  Eqs.  (20)  and  (21)  follow  immediately  from  the 
previous  two  bounds  and  the  inequalities  in  Eq.  (B3).  □ 


Appendix  D:  Sketch  of  the  Proof  of  Lemma  3 

To  prove  ISS,  it  is  first  shown  that  the  homogeneous  equation  of  the 
coordination  dynamics 


at)  =  F(nan  (Di) 

is  globally  uniformly  exponentially  stable  (GUES).  To  this  end, 
consider  the  system 


(j>(t)  =  —aL(t)4>(t)  (D2) 

where  a  is  the  proportional  coordination  control  gain  introduced 
in  Eq.  (26).  Letting  D(t)  be  the  time-varying  incidence  matrix, 
L(t)  =  D(t)DT(t),  one  can  rewrite  the  previous  system  as 
i/>(t)  =  —a{QD{t)){QD(t))Ttp{t).  Then,  because  QD{t)  is  piece- 
wise  constant  in  time  and,  in  addition,  one  has  that  ||  QD(t )  ||2  <  n,  it 
can  be  proven  that  the  system  in  Eq.  (D2)  is  GUES,  and  the  following 
bound  holds: 


11^(011  <kx\\m\\e^' 

with  k4  =  1  and  >  yx  =  [anp/(  1  +  anT)2].  This  result  can  be 
proven  along  the  same  lines  as  Lemma  5  in  [58]  or  Lemma  3  in  [59], 
Because  L(t)  is  continuous  for  almost  all  t>  0  and  uniformly 
bounded,  and  the  system  [Eq.  (D2)]  is  GUES,  Lemma  1  in  [59]  and  a 
similar  argument  as  in  [57]  (Theorem  4.12)  imply  that,  for  any  c3  and 
c4  satisfying  0  <  c3  <  c4,  there  exists  a  continuous,  piecewise- 
differentiable  PCo(t )  =  P^0(f)  such  that 

c  1 l  —  <  P ’c0(0  ^  ^I„-l  —  ^2^n— 1  (D3) 


PCo(n  -  aL(t)PCo(t )  -  aPCo(t)L(t )  <  -c3I„_i  (D4) 

Next,  define 


z(t)  =  s(at)  = 


u-n- 1 
b  rT 


C 1  Q 1 


at) 


and,  nothing  that  Amin(CT  QT  QC)  1  =  1,  consider  the  Lyapunov 
function  candidate 


Vc(t,z)  =  zT  P  c(t)z,  Pc(t)  = 


PcM 


0  fj(CTQTQQ~ 


The  time  derivative  of  Vc  along  the  trajectories  of  the  system  is 
given  by 
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VCU)  =  ZT(t) 


Pc(t)  -  aL(t)P c  (t)  -  aPc  (t)L(t)  +  y  QCCT QT Pc  (t)  +  ±PcAt)QCCTQT  PcAi)QC -  %QC 


CTQTPcM)-fCTQT 


b  ' 
n- 1 


z(0 


Now,  for  any  k p  >  2,  define  (3  =  kpn.  Then,  letting  a  >  0, 
Xc  =  +  P)~l,b  =  anXckp,  and  c3  =  c4  =  (y2/ 2C)(2/ kpn) ,  and 

noting  that  ||2C||  =  1  and  2max  (CT QT QC)~X  =  n,  one  can  use 
Eqs.  (D3)  and  (D4)  and  Schur  complements  to  prove  that 


VAt)  <  -2 lczT(t) 


0 

i(CTQTQC)-' 


z(t)  =  -2 AcVc(t) 


Application  of  the  comparison  lemma  (see  [57],  Lemma  3.4])  leads 
to  Vc(t)  <  yc(0)e~2*ct,  and  because  min{c1,^}[|z(l)||2  <  V/r) 
<  max{c2,|r}||z(t)||2,  one  finds  that 

/max]  c2,  fin  IV  7 

IlfWII  <  II VII  .  fc  3,  l|Sc||||C(0)||e-V 

V  min{c| ,  ) 

and  consequently  the  system  of  Eq.  (Dl)  is  GUES.  One  concludes 
that  the  forced  system  of  Eq.  (28)  is  ISS  because  it  is  a  linear  system, 
the  Laplacian  L(t)  is  bounded,  the  homogeneous  equation  is  GUES, 
and  the  speed-tracking  error  vector  ev(t)  is  assumed  to  be  bounded 
for  all  r  >  0.  This  implies  that  the  bound  in  Eq.  (29)  holds.  The 
constants  k\  and  k2  in  Eq.  (29)  can  be  derived  from  a  proof  similar  to 
those  of  Theorem  4. 19  and  Lemma  4.6  in  [57], 

To  prove  Eqs.  (30)  and  (31),  one  can  introduce  the  disagreement 
vector p(t )  =  IT//)  and  use  the  facts  that 


not  able  to  remain  inside  the  prespecified  tube  centered  on  its  desired 
path  or  its  speed  command  goes  outside  the  acceptable  feasible  range 
while  trying  to  keep  coordination  with  the  other  UAV s.  Without  loss 
of  generality,  assume  that  this  UAV  is  the  first  one  that  violates  (at 
least)  one  of  these  conditions,  and  therefore  suppose  that  all  other 
vehicles  do  satisfy  the  claims  of  the  theorem.  More  precisely, 
consider  the  ith  UAV  and  suppose  that,  at  time  t  >  0,  it  has  not  yet 
reached  the  final  destination,  i.e.,  /7(f)  <  1 .  Assume  that,  at  this  same 
time  instant  f,  either  the  path-following  errors  of  the  ith  UAV  are  such 
that  (pF  ,(f).  Rj(t))  $  Qc,  or  its  speed  command  vc  i(t)  does  not 
satisfy  the  bounds  vc  min  <  vci(t)  <  vc  max  (or  both).  For  all  other 
UAVs,  assume  that  (pF  ,(r),  Rj(r))  e  Qc  and  vc  mjn  <  vc  Tr)  < 
Vc  max,  e  {1,  •  •  • , «},  j  +  i,  and  for  all  r  G  [0.  t]. 

Consider  first  the  case  in  which  (pF  ,(i),  /?,•(/))  ^  Slc,  while 
vc  min  <  vc  i(r)  <  vc  max  for  all  r  G  [0,  f].  For  the  ith  UAV,  consider 
the  jtath-following  Lyapunov  function  candidate  ,(pF ,-, /?,)  = 
*P (Rj)  +  (l/c2)||pF,i|J2.  Because  (pF  ,(0),  K,(0))  G  Qc.  by  assump¬ 
tion,  and  V pf  i  evaluated  along  the  system  trajectories  is  continuous 
and  differentiable,  one  has  that,  if  (pF  At),  Ri(t))  &  klc  for  some 
t  >  0,  then  there  exists  a  time  t  ’  (0  <  t’  <  t)  such  that 


Tp/,,(1')  =  c2 

(El) 

Vpfj(t')  >  0 

(E2) 

6(0  -  I/O  =  Pi(t)  -  Pj(t),  ij  =1,2 . n;  (D5) 

IIpCOII  =  nil  (Oil  (D6) 


I2/0  i  =  2 . n  (D7) 

It  follows  from  the  relationships  of  Eqs.  (D5)  and  (D6)  that 
|£,(f)  —  |j(0|  <  2||Ci(f)||,  and  thus  Eq.  (29)  leads  to  Eq.  (30)  with 
k3  =  2 k2.  On  the  other  hand,  from  Eqs.  (25),  (27),  and  (D7),  one 
obtains 

i/o  - 1  =  - 1/0)  +  <1(0 

j^J  1 

ii(0  -  1  =  0  -  I/O)  +  C2J—1  ( 0  +  e',/0, 

jeJ, 

1  =  2,  ....  n 

which,  along  with  the  bound  in  Eq.  (29)  and  the  fact  that 
K/01  <[Ki(0l/UnJ,  lead  to  the  bound  in  Eq.  (31)  with 
k4  =  (2a (n  -  1)  +  1  )k2  +  (l/nmin).  □ 


while 

Vp/Ar)  <  c2,  V  r  G  [0,  f')  (E3) 

Equations  (El,  E3)  imply  that  ||pf  /r)||  <  CC|  and^l/^r))  <  c2for 
all  r  G  [0.  f'].  These  two  bounds,  along  with  the  choice  for  the 
characteristic  distance  d  in  Eq.  (33)  and  the  assumption  on  the  UAV 
dynamics  in  Eq.  (11),  imply  that  ,(t)  •  t/r)  >  c2  >  0  and  umin  < 
u, (t)  <  umax  for  all  r  G  [0,  f'].  Aproof  similarto  the  one  ofLemma2 
can  now  be  used  to  show  that,  for  all  r  G  [0,0],  V pf  j  <  0  on  the 
boundary  of  £ic,  which  contradicts  the  claim  in  Eqs.  (El)  and  (E2). 

Next,  consider  the  case  in  which  the  bounds  min  <  vc  i(t)  < 
nc max d° n°thold,  while (pf  /r), f?,(r))  G  f2cforallrG  [O.rJ.Letf' 
(0  <  f'  <  /)  be  the  first  time  at  which  vc  min  <  vcj  <  vc  max  is  not 
satisfied.  Then,  one  has  that,  at  time  f',  one  of  the  following  bounds 
holds: 

tic  min  7*  V c  j ( 1  ),  Or  Vcj(t  )  >•  Vc  max  (E4) 

while 

Vc  min  —  A  Vc  max,  V  T  G  [0,  f  )  (E5) 


Appendix  E:  Sketch  of  the  Proof  of  Theorem  1 

To  simplify  the  notation  in  this  proof  sketch,  define  the  positive 
constants  ucmin  and  ucmax  as  vc  min  =  timin  +  yv  and  ticmax  = 
tJmax  Yv 

From  the  assumptions  on  the  initial  conditions  in  Eqs.  (37)  and 
(38),  along  with  the  choice  for  the  characteristic  distance  d  in 
Eq.  (33),  it  can  be  shown  that  the  following  bounds  hold  at  time  t  =  0 
for  all  vehicles: 

Vc  min  —  Vcj(0)  A  Vc  max,  V  j  G  {1,  .  .  .  ,  ll} 

With  this  preliminary  result  in  mind,  the  claims  of  the  theorem  are 
now  proven  by  contradiction.  To  this  effect,  consider  one  of  the  UAV s 
involved  in  the  mission  that  has  not  yet  reached  its  final  destination, 
and  assume  that  it  violates  the  results  of  the  theorem,  that  is  either  it  is 


Because  (pF  ,/t),  Rj(z))  G  Qc  for  all  iG  [0,  t'\  by  hypothesis,  it 
follows  that  j|pF/r)||  <  cc\  and  *P(^,(r))  <  c 2  for  all  r  G  [0,  t'\. 
These  bounds,  along  with  the  choice  for  the  characteristic  distance  d 
in  Eq.  (33),  the  assumption  on  the  UAV  dynamics  in  Eq.  (11),  and  the 
bound  in  Eq.  (E5),  imply  that  w1;(r)  ■  t,(r)  >  c2forallrG  [0,f']and 
that  \ev  i(r)\  <  yv  and  umin  <  u/r)  <  umax  for  all  r  G  [0.  t').  From 
this  last  bound,  the  continuity  of  v,-,  and  the  fact  that  (by  hypothesis) 
the  bounds  vc  m;n  <  vcj(z)  <  vc  max  hold  for  all  j  G  {1,  . . . ,  n}, 
j  A  b  and  for  all  r  G  [0,  ?'],  it  follows  that  |e„  ,(r)|  <  yv  and  umin  < 
Vj(r)  <  umax  for  all  j  G  ]L  . . . ,  n},  j  /  i,  and  for  all  r  G  [0,  t'\. 
These  bounds,  along  with  the  hypothesis  that  (pF  j(z),  Rj(r))  G  Qc 
for  all  j  G  {1,  ....  n },  j  i=  i,  and  for  all  r  G  [0.  f'],  can  be  used  to 
prove  that  ev  ,(f')  is  bounded.  Then,  because  the  speed-tracking  error 
vector  e/r)  is  bounded  for  all  r  G  [0,  f '],  a  proof  similar  to  the  one  of 
Lemma  3  can  be  used  to  show  that  the  choice  of  the  coordination 
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control  gains  a  and  b  in  Eq.  (34)  ensures  that  there  exists  a  positive 
constant  Xc  such  that 

IlfMII  <  ki\\C(0)\\e~Xcr  +  k2  sup  ||c„(s)||,  V  r  e  [0,/'] 

se[0,r) 

Because  ||c„(r)||  <  J~njv  for  all  re[0,  ('),  it  follows  that 
||f(f')ll  <  /ti  ||f (0)||  +  k.2^/nyv.  This  bound,  along  with  Eqs.  (D5) 
and  (D6)  and  the  assumption  on  the  initial  condition  in  Eq.  (38),  can 
be  used  to  show  that  r>min  +  yv  <  uc  ,(f')  <  i>max  —  y„,  which 
contradicts  the  claim  in  Eq.  (E4). 

Finally,  similar  arguments  can  be  used  to  prove  the  impossibility  of 
both  (pF  i,  Rj)  e  Qc  and  vc  min  <  vc  i  <  vc  max  failing  to  hold  at  the 
exact  same  time. 

Therefore,  one  has  that,  for  all  i  E  { 1 ,  . . . ,  n}  and  for  all  t  >  0,  the 
path-following  errors  pp,i( t)  and  /?,(/)  satisfy  (pF j(t),  Ri(t))  E  £2C, 
while  the  speed  command  vc  i(t)  verifies  the  bounds  vc  min  <  vc  i{t) 
<  vc  max.  From  these  bounds  and  the  assumption  on  the  UAV 
dynamics  in  Eq.  (11),  it  follows  that  umin  <  (r)  <  i>max  for  all 

i  E  {1,  . . . ,n)  and  for  all  t  >  0.  Moreover,  the  choice  for  the 
characteristic  distance  d  in  Eq.  (33)  implies  that  w1(I(r)  •  t ,-(r)  > 
C2  >  0  for  all  i  E  {1,  . . . ,  n]  and  for  all  /  >  0.  Then,  the  bounds  in 
Eqs.  (39)-(41)  follow  respectively  from  proofs  similar  to  those  of 
Lemmas  2  and  3.  □ 
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